-- Logs begin at Wed 2021-12-15 15:35:54 UTC, end at Wed 2021-12-15 16:38:30 UTC. -- Dec 15 16:12:28.222912 dv-cinder-812685-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 15 16:12:28.232359 dv-cinder-812685-4-iscsi devstack@n-api.service[101873]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 15 16:12:28.234403 dv-cinder-812685-4-iscsi devstack@n-api.service[101873]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Dec 15 16:12:28 2021] *** Dec 15 16:12:28.234403 dv-cinder-812685-4-iscsi devstack@n-api.service[101873]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 15 16:12:28.234403 dv-cinder-812685-4-iscsi devstack@n-api.service[101873]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 15 16:12:28.234403 dv-cinder-812685-4-iscsi devstack@n-api.service[101873]: nodename: dv-cinder-812685-4-iscsi Dec 15 16:12:28.234403 dv-cinder-812685-4-iscsi devstack@n-api.service[101873]: machine: x86_64 Dec 15 16:12:28.234403 dv-cinder-812685-4-iscsi devstack@n-api.service[101873]: clock source: unix Dec 15 16:12:28.234403 dv-cinder-812685-4-iscsi devstack@n-api.service[101873]: pcre jit disabled Dec 15 16:12:28.234403 dv-cinder-812685-4-iscsi devstack@n-api.service[101873]: detected number of CPU cores: 4 Dec 15 16:12:28.234403 dv-cinder-812685-4-iscsi devstack@n-api.service[101873]: current working directory: / Dec 15 16:12:28.234403 dv-cinder-812685-4-iscsi devstack@n-api.service[101873]: detected binary path: /usr/bin/uwsgi-core Dec 15 16:12:28.234403 dv-cinder-812685-4-iscsi devstack@n-api.service[101873]: your processes number limit is 47680 Dec 15 16:12:28.234403 dv-cinder-812685-4-iscsi devstack@n-api.service[101873]: your memory page size is 4096 bytes Dec 15 16:12:28.234403 dv-cinder-812685-4-iscsi devstack@n-api.service[101873]: detected max file descriptor number: 2048 Dec 15 16:12:28.235215 dv-cinder-812685-4-iscsi devstack@n-api.service[101873]: lock engine: pthread robust mutexes Dec 15 16:12:28.235215 dv-cinder-812685-4-iscsi devstack@n-api.service[101873]: thunder lock: enabled Dec 15 16:12:28.235215 dv-cinder-812685-4-iscsi devstack@n-api.service[101873]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 15 16:12:28.235215 dv-cinder-812685-4-iscsi devstack@n-api.service[101873]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Dec 15 16:12:28.278701 dv-cinder-812685-4-iscsi devstack@n-api.service[101873]: Python main interpreter initialized at 0x55bb970be9c0 Dec 15 16:12:28.278701 dv-cinder-812685-4-iscsi devstack@n-api.service[101873]: python threads support enabled Dec 15 16:12:28.278701 dv-cinder-812685-4-iscsi devstack@n-api.service[101873]: your server socket listen backlog is limited to 100 connections Dec 15 16:12:28.278701 dv-cinder-812685-4-iscsi devstack@n-api.service[101873]: your mercy for graceful operations on workers is 90 seconds Dec 15 16:12:28.279122 dv-cinder-812685-4-iscsi devstack@n-api.service[101873]: mapped 403077 bytes (393 KB) for 2 cores Dec 15 16:12:28.279122 dv-cinder-812685-4-iscsi devstack@n-api.service[101873]: *** Operational MODE: preforking *** Dec 15 16:12:28.279399 dv-cinder-812685-4-iscsi devstack@n-api.service[101873]: *** uWSGI is running in multiple interpreter mode *** Dec 15 16:12:28.279399 dv-cinder-812685-4-iscsi devstack@n-api.service[101873]: spawned uWSGI master process (pid: 101873) Dec 15 16:12:28.279609 dv-cinder-812685-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 15 16:12:28.280475 dv-cinder-812685-4-iscsi devstack@n-api.service[101873]: spawned uWSGI worker 1 (pid: 101874, cores: 1) Dec 15 16:12:28.281764 dv-cinder-812685-4-iscsi devstack@n-api.service[101873]: spawned uWSGI worker 2 (pid: 101875, cores: 1) Dec 15 16:12:28.281764 dv-cinder-812685-4-iscsi devstack@n-api.service[101873]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 15 16:12:29.991500 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 16:12:29.991500 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: from cryptography.utils import int_from_bytes Dec 15 16:12:29.992340 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 16:12:29.992340 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: from cryptography.utils import int_from_bytes Dec 15 16:12:30.057192 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 16:12:30.057192 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: from cryptography.utils import int_from_bytes Dec 15 16:12:30.058247 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 16:12:30.058247 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: from cryptography.utils import int_from_bytes Dec 15 16:12:32.600852 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 16:12:32.601397 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 16:12:32.601490 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 16:12:32.601830 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 16:12:32.602096 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 16:12:32.602461 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.602782 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.603099 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.603467 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.603795 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.604103 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.604420 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.604735 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.605055 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.605307 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.605617 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.605934 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-812685-4-iscsi {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.606322 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.606635 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.607087 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.607439 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.607741 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.608058 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.608358 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.608866 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.609316 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.609619 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.609922 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.610246 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.610566 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.610858 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.611165 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.611386 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 16:12:32.611803 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.611875 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 16:12:32.611950 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.612098 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.612190 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 16:12:32.612479 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 16:12:32.612578 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-812685-4-iscsi {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.612736 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 16:12:32.612829 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.613087 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.613178 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.613399 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.613491 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.613756 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.613840 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.614074 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.614160 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.614390 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.614470 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.614696 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.614786 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.615011 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.615104 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.615315 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.615421 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.615665 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.615757 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.615928 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.616027 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.616243 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.616327 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.616566 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-812685-4-iscsi {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.616651 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.616869 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.616973 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.617192 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.617343 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.617484 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.617582 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.617788 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.617880 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.618091 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.618181 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.618394 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.618513 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.618647 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.618786 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.618953 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.619268 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.619437 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.619623 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.619793 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.619937 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.620037 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.620186 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.620274 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.620433 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.620579 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.620751 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.620895 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.621068 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.621205 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.621372 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.621522 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.621677 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.622085 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.622225 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.622448 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.622757 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.622860 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.623061 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.623164 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.623382 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.623510 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-812685-4-iscsi {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.623686 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.623840 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.624004 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.624159 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.624326 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.624478 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.624648 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.624894 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.624998 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.625218 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.625313 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.625536 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.625664 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.625862 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.625959 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.626171 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.626254 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.626477 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.626574 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.626803 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.626888 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.627104 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.627186 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.627437 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.627542 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.627755 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.627839 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.628054 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.628152 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.628385 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.628498 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.628691 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.628794 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.629005 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.629090 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.629332 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.629418 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.629632 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.629718 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.629879 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.629967 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.630175 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.630276 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.630474 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.630559 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.630788 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.630873 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.631089 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.631183 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.631342 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.631456 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.631622 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.631722 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.631942 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.632028 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.632262 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.632352 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.632566 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.632699 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.632870 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.632955 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.633174 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.633259 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.633477 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.633570 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.633775 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.633859 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.634079 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.634171 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.634380 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.634473 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.634679 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.634771 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.634989 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.635084 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.635300 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.635411 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.635625 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.635709 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.635926 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.636011 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.636229 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.636317 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.636533 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.636626 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.636852 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.636938 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.637154 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.637241 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.637497 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.637615 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.637891 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.638218 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.638414 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.638502 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.638743 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.638860 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.639066 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.639168 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.639396 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.639488 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.639709 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.639798 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.640005 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.640092 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.640309 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.640400 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.640624 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.640718 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.640930 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.641027 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.641232 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.641332 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.641482 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.641573 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.641788 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.641883 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.642094 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.642196 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.642396 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.642499 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.642693 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.642801 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.642994 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.643090 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.643287 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.643392 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.643624 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.643730 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.643930 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.644014 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.644240 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.644331 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.644548 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.644654 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.644854 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.644940 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.645161 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.645266 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.645466 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.645564 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.645774 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.645892 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.646078 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.646186 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.646416 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.646510 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.646699 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.646805 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.647018 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.647121 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.647334 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.647472 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.647661 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.647746 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.647970 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.648065 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.648277 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.648381 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.648596 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.648684 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.648905 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.649003 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.649213 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.649302 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.649535 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.649620 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.649841 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.649944 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.650147 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.650243 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.650457 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.650540 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.650761 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.650857 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.651066 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.651165 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.651393 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.651480 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.651696 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.651797 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.652007 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.652092 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.652318 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.652417 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.652624 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.652732 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.652933 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.653038 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.653364 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.653657 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.653845 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.653983 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.654182 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.654291 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.654494 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.654606 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.654806 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.654966 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.655159 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.655276 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.655497 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.655640 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.655840 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.655969 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.656198 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.656284 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.656521 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.656628 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.656832 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.656923 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.657140 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.657225 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.657446 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.657530 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.657766 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:12:32.657865 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.658069 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.658153 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.658369 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.658453 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.658675 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.658761 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.658979 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.659086 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.659295 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.659418 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.659641 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.659779 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.659946 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.660032 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.660274 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.660369 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.660576 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.660661 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.660884 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.660968 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.661191 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.661289 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.661493 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.661578 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.661801 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.661889 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.662108 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.662203 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.662409 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.662493 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.662748 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.662846 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.663033 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.663119 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.663336 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.663537 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.663681 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.663777 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.663982 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.664068 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.664286 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.664382 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.664597 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.664683 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.664904 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.664991 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.665209 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.665296 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.665516 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.665601 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.665833 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.665920 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.666139 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.666225 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.666443 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.666542 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.666774 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.666860 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.667093 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.667176 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.667408 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.667509 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.667731 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.667823 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.668043 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.668127 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.668350 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.668450 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.668650 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.668797 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.669014 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.669252 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.669353 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.669600 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.669684 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.669902 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.669994 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.670206 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.670299 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.670507 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.670600 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.670806 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.670897 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.671107 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.671200 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.671424 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.671516 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.671725 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.671806 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.672042 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.672144 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.672343 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.672429 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.672641 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.672736 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.672940 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.673043 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.673234 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.673319 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.673576 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.673738 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.673891 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.674037 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.674198 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.674342 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.674506 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.674644 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.674819 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.674952 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.675140 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.675276 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.675447 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.675588 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.675740 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.675871 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.676051 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.676198 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.676366 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.676518 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.676660 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.676795 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.676959 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.677100 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.677273 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.677437 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.677571 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.677710 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.677892 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.678038 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.678197 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.678334 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.678516 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.678660 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.678830 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.678960 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.679142 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.679306 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.679464 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.679551 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.679779 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.679863 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.680113 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.680241 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.680440 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.680598 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.680745 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.680888 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.681035 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.681167 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.681340 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.681485 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.681642 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.681775 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.681933 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.682059 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.682235 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.682363 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.682538 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.682678 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.682842 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.682937 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.683140 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.683269 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.683462 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.683570 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.683759 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.683905 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.684059 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.684190 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.684460 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.684650 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.684853 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.685053 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.685244 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.685376 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.685505 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.685659 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.685793 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.685932 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.686065 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.686196 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.686329 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.686541 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.686674 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.686831 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.686972 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.687180 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.687314 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.687534 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.687621 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.687841 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.687926 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.688147 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.688231 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.688449 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.688535 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.688749 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.688842 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.689079 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.689183 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.689364 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.689457 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.689668 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.689759 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.689973 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.690072 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.690274 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.690368 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.690583 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.690687 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.690884 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.690979 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.691182 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.691266 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.691500 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.691593 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.691807 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.691908 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.692123 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.692208 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.692429 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.692513 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.692744 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.692829 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.693065 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.693223 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.693361 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.693515 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.693662 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.693816 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.693948 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.694080 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.694232 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.694366 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.694532 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.694667 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.694829 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.694964 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.695127 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.695259 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.695486 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.695621 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.695790 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.695950 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.696073 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.696215 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.696389 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.696523 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.696710 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.696844 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.697014 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.697154 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.697324 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.697466 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.697629 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.697767 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.697932 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.698073 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.698254 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.698389 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.698547 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.698680 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.698852 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.698994 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.699157 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.699353 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.699514 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.699662 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.699795 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.699958 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.700153 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.700428 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.700760 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.700904 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.701088 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.701223 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.701404 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.701537 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.701720 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.701863 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.702016 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.702175 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.702324 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.702465 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.702637 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.702941 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.703101 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.703261 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.703468 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.703596 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.703681 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.703900 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.704010 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.704225 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.704326 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.704536 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.704619 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.704841 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.704935 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.705145 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.705239 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.705460 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.705549 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.705760 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.705847 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.706067 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.706156 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.706367 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.706462 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.706674 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.706770 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.706996 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.707079 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.707304 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.707420 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.707632 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.707723 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.707931 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.708016 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.708243 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.708337 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.708541 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.708655 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.708847 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.708949 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.709173 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.709296 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.709478 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.709574 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.709791 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.709872 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.710093 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.710186 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.710402 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.710496 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.710708 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.710797 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.711020 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.711116 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.711330 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.711473 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.711656 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.711749 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.711954 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.712045 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.712253 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.712343 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.712587 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.712677 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.712883 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.713049 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.713200 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.713283 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.713519 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.713614 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.713831 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.713926 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.714137 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.714220 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.714436 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.714528 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.714753 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.714847 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.715050 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.715135 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.715347 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.715446 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.715739 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.715862 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.716316 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.716532 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.716629 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.716839 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.717154 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.717239 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.717460 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.717567 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.717781 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.717871 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.718084 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.718171 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.718409 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.718500 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.718736 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.718841 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.719038 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.719123 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.719349 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.719497 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.719705 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.719797 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.720348 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.720450 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.720653 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.720737 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.720956 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.721052 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.721256 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.721346 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.721552 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.721636 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.721854 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.721949 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.722154 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.722245 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.722463 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.722545 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.722780 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.722876 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.723076 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.723160 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.723454 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.723567 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.723697 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.723793 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.724002 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.724095 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.724301 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.724404 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.724606 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.724690 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.724924 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.725011 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.725224 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.725334 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.725514 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.725615 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.725818 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.725912 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.726118 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.726204 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.726414 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.726512 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.726713 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.726798 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.727046 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.727130 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.727350 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.727464 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.727709 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.727817 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.728042 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.728133 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.728347 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.728446 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.728647 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.728741 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.728943 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.729028 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.729248 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.729341 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.729544 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.729629 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.729840 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.729925 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.730135 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.730221 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.730430 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.730537 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.730725 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.730811 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.731040 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.731137 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.731452 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.731762 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.731989 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.732077 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.732315 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.732402 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.732632 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.732729 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.732948 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.733045 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.733253 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.733338 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.733568 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.733731 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.733864 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.734009 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.734172 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.734263 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.734477 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.734621 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.734760 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.734924 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.735057 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.735195 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.735354 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.735512 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.735683 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.735828 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.735986 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.736120 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.736290 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.736421 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.736569 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.736711 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.736867 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.737007 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.737177 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.737311 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.737477 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.737617 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.737779 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.737911 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.738085 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.738225 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.738394 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.738524 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.738695 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.738810 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.738991 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.739077 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.739294 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.739402 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.739621 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.739718 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.739919 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.740003 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.740220 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.740305 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.740521 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.740605 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.740823 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.740921 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.741127 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.741211 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.741428 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.741511 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.741732 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.741824 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.742032 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.742116 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.742330 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.742414 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.742633 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.742726 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.742933 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.743017 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.743229 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.743312 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.743560 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.743662 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.743862 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.743965 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.744157 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.744241 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.744459 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.744599 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.744753 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.744838 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.745051 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.745135 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.745346 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.745432 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.745677 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.745784 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.746017 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.746105 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.746334 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.746432 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.746633 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.746718 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.746972 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.747077 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.747279 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.747625 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.747946 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.748058 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.748302 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.748417 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.748569 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.748690 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.748887 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.748997 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.749212 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.749307 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.749528 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.749613 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.749844 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.749930 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.750170 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.750263 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.750471 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.750562 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.750786 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.750879 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.751082 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.751175 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.751394 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.751498 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.751699 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.751784 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.751997 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.752082 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.752300 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.752392 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.752613 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.752703 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.752929 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.753019 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.753245 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.753330 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.753573 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.753657 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.753897 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.753996 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.754200 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.754286 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.754513 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.754598 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.754822 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.754908 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.755131 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.755225 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.755461 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.755565 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.755779 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.755878 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.756083 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.756172 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.756392 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.756486 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.756700 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.756791 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.757008 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.757095 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.757311 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.757409 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.757620 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.757705 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.757917 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.758006 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.758228 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.758321 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.758531 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.758627 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.758835 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.758921 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.759146 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.759231 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.759473 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.759651 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.759783 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.759968 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.760088 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.760275 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.760396 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.760590 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.760703 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.760910 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.761142 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.761233 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.761510 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.761615 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.761823 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.761909 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.762119 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.762204 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.762435 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.762592 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.762998 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.763308 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.763479 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.763654 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.763740 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.763967 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.764075 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.764270 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.764357 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.764571 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.764749 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.764873 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.765066 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.765191 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.765379 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.765492 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.765694 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.765807 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.765999 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.766100 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.766301 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.766418 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.766611 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.766737 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.766937 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.767024 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.767242 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.767327 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.767571 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.767658 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.767875 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.767962 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.768197 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.768295 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.768500 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.768586 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.768819 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.768903 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.769121 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.769236 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.769438 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.769549 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.769766 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.769850 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.770093 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.770255 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.770400 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.770569 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.770726 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.770878 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.771050 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.771199 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.771359 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.771551 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.771690 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.771876 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.772008 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.772181 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.772308 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.772492 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.772606 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.772807 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.772894 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.773128 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.773224 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.773445 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.773538 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.773756 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.773843 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.774075 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.774182 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.774373 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.774455 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.774642 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.774771 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.774942 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.775028 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.775255 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.775350 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.775580 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.775669 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.775896 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.775980 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.776198 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.776294 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.776498 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.776585 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.776800 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.776906 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.777097 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.777232 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.777431 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.777525 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.777731 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.777824 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.778088 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.778192 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.778493 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.778815 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.779025 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.779140 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.779339 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.779493 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.779687 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.779776 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.779996 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.780090 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.780310 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.780399 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.780625 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.780711 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.780938 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.781023 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.781242 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.781329 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.781546 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.781638 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.781862 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.781945 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.782162 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.782254 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.782471 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.782555 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.782782 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.782877 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.783097 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.783182 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.783436 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.783691 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.783777 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.784018 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.784110 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.784332 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.784434 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.784637 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.784854 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.784949 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.785171 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.785258 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.785485 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.785570 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.785798 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.785893 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.786107 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.786193 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.786417 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.786502 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.786729 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.786815 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.787034 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.787120 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.787360 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.787508 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.787699 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.787788 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.788019 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.788104 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.788336 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.788421 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.788646 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.788732 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.788944 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.789030 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.789245 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.789344 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.789551 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.789637 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.789854 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.789939 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.790156 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.790251 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.790457 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.790541 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.790759 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.790844 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.791057 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.791152 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.791357 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.791466 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.791689 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.791774 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.791997 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.792084 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.792294 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.792378 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.792601 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.792684 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.792907 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.792994 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.793206 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.793290 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.793508 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.793594 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.793869 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.794182 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.794344 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.794510 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.794691 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.794826 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.794999 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.795134 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.795335 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.795463 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.795682 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.795780 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.796008 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.796272 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.796367 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.796588 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.796673 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.796917 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.797011 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.797240 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.797339 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.797553 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.797638 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.797863 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.797949 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.798177 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.798261 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.798492 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.798587 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.798793 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.798877 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.799096 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.799188 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.799426 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.799527 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.799733 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.799817 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.800032 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.800116 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.800348 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.800447 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.800656 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.800904 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.800991 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.801232 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.801318 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.801547 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.801634 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.801860 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.802073 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.802184 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.802418 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.802506 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.802732 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.802832 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.803053 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.803160 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.803481 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.803597 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.803679 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.803757 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.803983 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.804088 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.804301 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.804441 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.804603 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.804691 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.804903 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.805000 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.805215 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.805302 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.805523 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.805621 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.805824 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.805921 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.806125 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.806222 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.806437 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.806522 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.806742 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.806837 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.807041 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.807128 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.807347 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.807508 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.807672 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.807759 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.807997 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.808087 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.808299 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.808394 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.808598 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.808689 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.808897 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.808989 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.809208 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.809331 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.809538 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.809845 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.810121 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.810232 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.810429 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.810522 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.810758 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.810847 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.811076 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.811163 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.811412 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.811530 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.811741 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.811844 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.812048 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.812151 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.812347 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.812445 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.812652 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.812747 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.812952 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.813037 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.813269 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.813379 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.813572 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.813798 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.813885 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.814115 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.814210 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.814453 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.814602 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.814777 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.814923 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.815102 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.815245 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.815426 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.815516 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.815758 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.815855 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.816068 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.816166 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.816381 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.816611 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.816697 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.816981 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.817080 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.817289 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.817432 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.817592 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.817682 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.817913 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.818086 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.818222 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.818318 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.818525 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.818612 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.818822 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.818920 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.819140 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.819249 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.819472 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.819703 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.819812 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.820053 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.820153 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.820368 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.820463 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.820692 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.820787 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.821014 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.821109 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.821326 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.821465 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.821633 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.821740 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.821942 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.822065 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.822244 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.822338 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.822548 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.822656 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.822866 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.822962 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.823176 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.823286 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.823510 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.823634 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.823813 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.823915 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.824438 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.824537 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.824537 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.824670 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.824735 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.824798 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.825096 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.825401 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.825723 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.825874 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.826021 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.826172 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.826328 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.826460 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.826669 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.826816 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.826980 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.827122 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.827276 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.827443 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.827614 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.827703 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.827920 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.828007 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.828224 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.828323 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.828529 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.828622 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.828833 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.828924 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.829143 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.829238 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.829448 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.829535 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.829756 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.829849 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.830059 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.830153 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.830368 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.830461 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.830670 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.830756 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.830979 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.831067 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.831280 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.831395 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.831611 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.831710 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.831914 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.832002 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.832217 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.832328 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.832532 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.832629 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.832841 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.832946 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.833164 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.833260 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.833471 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.833565 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.833779 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.833888 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.834081 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.834181 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.834399 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.834544 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.834711 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.834939 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.835070 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.835317 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.835494 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.835665 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.835796 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.835987 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.836134 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.836300 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.836446 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.836616 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.836747 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.836921 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.837047 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.837224 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.837354 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.837527 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.837679 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.837838 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.837977 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.838147 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.838315 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.838447 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.838581 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.838748 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.838885 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.839054 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.839192 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.839362 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.839469 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.839691 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.839777 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.839999 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.840103 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.840307 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.840393 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.840645 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.840803 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.840942 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.841333 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.841470 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.841647 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.841797 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.841964 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.842122 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.842349 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.842447 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.842601 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.842753 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.842923 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.843072 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.843244 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.843406 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.843590 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.843718 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.843930 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.844026 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.844242 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.844338 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.844664 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.844756 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.845297 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.845393 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.845610 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.845697 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.845915 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.846032 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.846233 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.846350 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.846458 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101875) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 16:12:32.846668 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.846989 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.847300 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.847657 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.847978 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.848294 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.848615 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.848939 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.849259 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.849602 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.849928 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.850251 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.850555 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.850920 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.851173 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.851511 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.851843 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.852181 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.852506 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.852819 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.853129 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.853455 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.853760 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.854080 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.854399 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.854709 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.855016 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.855460 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.855678 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.855988 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.856517 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.857319 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.857632 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.857957 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.858285 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.858614 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.858925 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.859249 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.859608 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.859934 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.860249 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.860560 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.860891 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.861201 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.861518 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.861836 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.862194 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.862551 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.862870 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.863202 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.863553 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.863882 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.864210 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.864554 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.865134 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.865312 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.865790 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.866112 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.866427 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.866736 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:12:32.866978 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 16:12:32.869530 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG oslo_db.sqlalchemy.engines [None req-5b8e1a15-d77a-4ce2-b0a6-e8e489ce0d80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101875) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 16:12:32.890966 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG oslo_db.sqlalchemy.engines [None req-153ad51f-66fb-4595-a5f7-53da65a3d6d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101874) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 16:12:32.935965 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.context [None req-5b8e1a15-d77a-4ce2-b0a6-e8e489ce0d80 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12(cell1) {{(pid=101875) load_cells /opt/stack/nova/nova/context.py:464}} Dec 15 16:12:32.940277 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG oslo_concurrency.lockutils [None req-5b8e1a15-d77a-4ce2-b0a6-e8e489ce0d80 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:32.941846 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG oslo_concurrency.lockutils [None req-5b8e1a15-d77a-4ce2-b0a6-e8e489ce0d80 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:32.942653 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG oslo_concurrency.lockutils [None req-5b8e1a15-d77a-4ce2-b0a6-e8e489ce0d80 None None] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:32.944625 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG oslo_concurrency.lockutils [None req-5b8e1a15-d77a-4ce2-b0a6-e8e489ce0d80 None None] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101875) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:32.956076 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG oslo_db.sqlalchemy.engines [None req-5b8e1a15-d77a-4ce2-b0a6-e8e489ce0d80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101875) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 16:12:32.959210 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG oslo_db.sqlalchemy.engines [None req-5b8e1a15-d77a-4ce2-b0a6-e8e489ce0d80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101875) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 16:12:32.959718 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.context [None req-153ad51f-66fb-4595-a5f7-53da65a3d6d3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12(cell1) {{(pid=101874) load_cells /opt/stack/nova/nova/context.py:464}} Dec 15 16:12:32.964017 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG oslo_concurrency.lockutils [None req-153ad51f-66fb-4595-a5f7-53da65a3d6d3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:32.965685 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG oslo_concurrency.lockutils [None req-153ad51f-66fb-4595-a5f7-53da65a3d6d3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:32.967204 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG oslo_concurrency.lockutils [None req-153ad51f-66fb-4595-a5f7-53da65a3d6d3 None None] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:12:32.969242 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG oslo_concurrency.lockutils [None req-153ad51f-66fb-4595-a5f7-53da65a3d6d3 None None] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:12:32.982564 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG oslo_db.sqlalchemy.engines [None req-153ad51f-66fb-4595-a5f7-53da65a3d6d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101874) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 16:12:32.984828 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG oslo_db.sqlalchemy.engines [None req-153ad51f-66fb-4595-a5f7-53da65a3d6d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101874) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 16:12:33.128994 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG oslo_db.sqlalchemy.engines [None req-5b8e1a15-d77a-4ce2-b0a6-e8e489ce0d80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101875) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 16:12:33.151448 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG oslo_db.sqlalchemy.engines [None req-153ad51f-66fb-4595-a5f7-53da65a3d6d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101874) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 16:12:33.474306 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: WARNING keystonemiddleware.auth_token [None req-5b8e1a15-d77a-4ce2-b0a6-e8e489ce0d80 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 16:12:33.480930 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: WARNING keystonemiddleware.auth_token [None req-5b8e1a15-d77a-4ce2-b0a6-e8e489ce0d80 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 16:12:33.488499 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: WARNING keystonemiddleware.auth_token [None req-153ad51f-66fb-4595-a5f7-53da65a3d6d3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 16:12:33.495199 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: WARNING keystonemiddleware.auth_token [None req-153ad51f-66fb-4595-a5f7-53da65a3d6d3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 16:12:33.831175 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: WARNING keystonemiddleware.auth_token [None req-5b8e1a15-d77a-4ce2-b0a6-e8e489ce0d80 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 16:12:33.836584 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: WARNING keystonemiddleware.auth_token [None req-5b8e1a15-d77a-4ce2-b0a6-e8e489ce0d80 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 16:12:33.839410 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: WARNING keystonemiddleware.auth_token [None req-153ad51f-66fb-4595-a5f7-53da65a3d6d3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 16:12:33.841862 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bb970be9c0 pid: 101875 (default app) Dec 15 16:12:33.843962 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi [None req-5b8e1a15-d77a-4ce2-b0a6-e8e489ce0d80 None None] Calling method '>' {{(pid=101875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:12:33.844782 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: WARNING keystonemiddleware.auth_token [None req-153ad51f-66fb-4595-a5f7-53da65a3d6d3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 16:12:33.845567 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: INFO nova.api.openstack.requestlog [None req-5b8e1a15-d77a-4ce2-b0a6-e8e489ce0d80 None None] 10.222.0.60 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001746 Dec 15 16:12:33.845958 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: [pid: 101875|app: 0|req: 1/1] 10.222.0.60 () {50 vars in 788 bytes} [Wed Dec 15 16:12:33 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:12:33.850621 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bb970be9c0 pid: 101874 (default app) Dec 15 16:14:03.273709 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi [None req-5b8e1a15-d77a-4ce2-b0a6-e8e489ce0d80 None None] Calling method '>' {{(pid=101875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:03.275295 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: INFO nova.api.openstack.requestlog [None req-5b8e1a15-d77a-4ce2-b0a6-e8e489ce0d80 None None] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002250 Dec 15 16:14:03.275967 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: [pid: 101875|app: 0|req: 2/2] 10.222.0.60 () {54 vars in 930 bytes} [Wed Dec 15 16:14:03 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:14:03.784102 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi [None req-db2acfbb-e562-46b4-8895-503aeda4f269 admin admin] Calling method '>' {{(pid=101874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:03.816386 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: INFO nova.api.openstack.requestlog [None req-db2acfbb-e562-46b4-8895-503aeda4f269 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.527474 Dec 15 16:14:03.823574 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: [pid: 101874|app: 0|req: 1/3] 10.222.0.60 () {60 vars in 1291 bytes} [Wed Dec 15 16:14:03 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:06.427422 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi [None req-5b8e1a15-d77a-4ce2-b0a6-e8e489ce0d80 None None] Calling method '>' {{(pid=101875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:06.428432 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: INFO nova.api.openstack.requestlog [None req-5b8e1a15-d77a-4ce2-b0a6-e8e489ce0d80 None None] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Dec 15 16:14:06.429084 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: [pid: 101875|app: 0|req: 3/4] 10.222.0.60 () {54 vars in 930 bytes} [Wed Dec 15 16:14:06 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:14:06.504601 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi [None req-b0697f79-d1c3-4a01-b488-39f6b24f04ad admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 1, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "id": "c1", "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1}} {{(pid=101874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:06.524932 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:14:06.524932 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: warnings.warn(msg) Dec 15 16:14:06.565118 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: INFO nova.api.openstack.requestlog [None req-b0697f79-d1c3-4a01-b488-39f6b24f04ad admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.128130 Dec 15 16:14:06.565718 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: [pid: 101874|app: 0|req: 2/5] 10.222.0.60 () {64 vars in 1282 bytes} [Wed Dec 15 16:14:06 2021] POST /compute/v2.1/flavors => generated 407 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:14:06.813576 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi [None req-f3c6e4dd-820b-4109-b327-ba3d24bbcdaf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:06.816108 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:14:06.816108 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: warnings.warn(msg) Dec 15 16:14:06.878817 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: INFO nova.api.openstack.requestlog [None req-f3c6e4dd-820b-4109-b327-ba3d24bbcdaf admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.300893 Dec 15 16:14:06.879702 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: [pid: 101875|app: 0|req: 4/6] 10.222.0.60 () {64 vars in 1335 bytes} [Wed Dec 15 16:14:06 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:09.407581 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi [None req-b0697f79-d1c3-4a01-b488-39f6b24f04ad admin admin] Calling method '>' {{(pid=101874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:09.408623 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: INFO nova.api.openstack.requestlog [None req-b0697f79-d1c3-4a01-b488-39f6b24f04ad admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001555 Dec 15 16:14:09.409046 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: [pid: 101874|app: 0|req: 3/7] 10.222.0.60 () {54 vars in 930 bytes} [Wed Dec 15 16:14:09 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:14:09.568086 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi [None req-20842723-0bc6-4600-8b82-6eb85d064a01 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds512M", "ram": 512, "swap": 0, "os-flavor-access:is_public": true, "id": "d1", "disk": 5, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:09.604366 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:14:09.604366 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: warnings.warn(msg) Dec 15 16:14:09.638697 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: INFO nova.api.openstack.requestlog [None req-20842723-0bc6-4600-8b82-6eb85d064a01 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.220968 Dec 15 16:14:09.639624 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: [pid: 101875|app: 0|req: 5/8] 10.222.0.60 () {64 vars in 1282 bytes} [Wed Dec 15 16:14:09 2021] POST /compute/v2.1/flavors => generated 404 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:14:09.658559 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi [None req-52e51f38-1534-4646-ade4-beae4e741c95 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:09.663799 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:14:09.663799 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: warnings.warn(msg) Dec 15 16:14:09.712138 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: INFO nova.api.openstack.requestlog [None req-52e51f38-1534-4646-ade4-beae4e741c95 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.060361 Dec 15 16:14:09.712926 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: [pid: 101874|app: 0|req: 4/9] 10.222.0.60 () {64 vars in 1335 bytes} [Wed Dec 15 16:14:09 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:14:12.815306 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi [None req-20842723-0bc6-4600-8b82-6eb85d064a01 admin admin] Calling method '>' {{(pid=101875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:12.816463 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: INFO nova.api.openstack.requestlog [None req-20842723-0bc6-4600-8b82-6eb85d064a01 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001699 Dec 15 16:14:12.817202 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: [pid: 101875|app: 0|req: 6/10] 10.222.0.60 () {54 vars in 930 bytes} [Wed Dec 15 16:14:12 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:14:12.923912 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi [None req-7cc3402b-c16c-44c5-ba43-3730356fc97c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 1024, "name": "ds1G", "id": "d2", "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "disk": 10}} {{(pid=101874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:12.952159 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: INFO nova.api.openstack.requestlog [None req-7cc3402b-c16c-44c5-ba43-3730356fc97c admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.126529 Dec 15 16:14:12.954355 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: [pid: 101874|app: 0|req: 5/11] 10.222.0.60 () {64 vars in 1282 bytes} [Wed Dec 15 16:14:12 2021] POST /compute/v2.1/flavors => generated 404 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:14:12.972910 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi [None req-701a809f-c3de-4f12-8661-fe5542361d51 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:13.011773 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: INFO nova.api.openstack.requestlog [None req-701a809f-c3de-4f12-8661-fe5542361d51 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042264 Dec 15 16:14:13.013097 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: [pid: 101875|app: 0|req: 7/12] 10.222.0.60 () {64 vars in 1335 bytes} [Wed Dec 15 16:14:12 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:15.544566 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi [None req-7cc3402b-c16c-44c5-ba43-3730356fc97c admin admin] Calling method '>' {{(pid=101874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:15.545599 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: INFO nova.api.openstack.requestlog [None req-7cc3402b-c16c-44c5-ba43-3730356fc97c admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Dec 15 16:14:15.545990 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: [pid: 101874|app: 0|req: 6/13] 10.222.0.60 () {54 vars in 930 bytes} [Wed Dec 15 16:14:15 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:14:15.614595 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi [None req-17263e9d-118f-45ca-954f-ae7aaadd1a61 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 2, "disk": 10, "name": "ds2G", "ram": 2048, "id": "d3", "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=101875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:15.638077 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: INFO nova.api.openstack.requestlog [None req-17263e9d-118f-45ca-954f-ae7aaadd1a61 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.084758 Dec 15 16:14:15.639258 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: [pid: 101875|app: 0|req: 8/14] 10.222.0.60 () {64 vars in 1282 bytes} [Wed Dec 15 16:14:15 2021] POST /compute/v2.1/flavors => generated 404 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:14:15.652083 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi [None req-8279b3af-5026-42b6-9a85-a21b42be9bce admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:15.677423 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: INFO nova.api.openstack.requestlog [None req-8279b3af-5026-42b6-9a85-a21b42be9bce admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028975 Dec 15 16:14:15.678010 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: [pid: 101874|app: 0|req: 7/15] 10.222.0.60 () {64 vars in 1335 bytes} [Wed Dec 15 16:14:15 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:18.453717 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi [None req-17263e9d-118f-45ca-954f-ae7aaadd1a61 admin admin] Calling method '>' {{(pid=101875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:18.455071 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: INFO nova.api.openstack.requestlog [None req-17263e9d-118f-45ca-954f-ae7aaadd1a61 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002997 Dec 15 16:14:18.455823 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: [pid: 101875|app: 0|req: 9/16] 10.222.0.60 () {54 vars in 930 bytes} [Wed Dec 15 16:14:18 2021] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:14:18.520308 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi [None req-30c474bc-3896-43bf-8c64-d6d9dcf62f00 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "swap": 0, "name": "ds4G", "id": "d4", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 4}} {{(pid=101874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:18.542855 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: INFO nova.api.openstack.requestlog [None req-30c474bc-3896-43bf-8c64-d6d9dcf62f00 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.080187 Dec 15 16:14:18.543555 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: [pid: 101874|app: 0|req: 8/17] 10.222.0.60 () {64 vars in 1282 bytes} [Wed Dec 15 16:14:18 2021] POST /compute/v2.1/flavors => generated 404 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:14:18.557746 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi [None req-2666b3a7-e511-4c25-b877-017be5110fbb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:18.585049 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: INFO nova.api.openstack.requestlog [None req-2666b3a7-e511-4c25-b877-017be5110fbb admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031683 Dec 15 16:14:18.585977 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: [pid: 101875|app: 0|req: 10/18] 10.222.0.60 () {64 vars in 1335 bytes} [Wed Dec 15 16:14:18 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:21.238724 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi [None req-30c474bc-3896-43bf-8c64-d6d9dcf62f00 admin admin] Calling method '>' {{(pid=101874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:21.240183 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: INFO nova.api.openstack.requestlog [None req-30c474bc-3896-43bf-8c64-d6d9dcf62f00 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002212 Dec 15 16:14:21.240722 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: [pid: 101874|app: 0|req: 9/19] 10.222.0.60 () {54 vars in 930 bytes} [Wed Dec 15 16:14:21 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:14:21.309935 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi [None req-0c8ed5b7-d280-4cef-853b-96f58a3131c1 admin admin] Calling method '>' {{(pid=101875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:21.334405 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: INFO nova.api.openstack.requestlog [None req-0c8ed5b7-d280-4cef-853b-96f58a3131c1 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.084939 Dec 15 16:14:21.334965 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: [pid: 101875|app: 0|req: 11/20] 10.222.0.60 () {60 vars in 1291 bytes} [Wed Dec 15 16:14:21 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:14:24.262124 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi [None req-30c474bc-3896-43bf-8c64-d6d9dcf62f00 admin admin] Calling method '>' {{(pid=101874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:24.264784 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: INFO nova.api.openstack.requestlog [None req-30c474bc-3896-43bf-8c64-d6d9dcf62f00 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003055 Dec 15 16:14:24.267416 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: [pid: 101874|app: 0|req: 10/21] 10.222.0.60 () {54 vars in 930 bytes} [Wed Dec 15 16:14:24 2021] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:14:24.375774 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi [None req-bdb47283-33f1-4f7c-9eb4-78b1b961b246 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "disk": 1, "rxtx_factor": 1.0, "name": "m1.tiny", "id": "1"}} {{(pid=101875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:24.400427 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: INFO nova.api.openstack.requestlog [None req-bdb47283-33f1-4f7c-9eb4-78b1b961b246 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.122467 Dec 15 16:14:24.401152 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: [pid: 101875|app: 0|req: 12/22] 10.222.0.60 () {64 vars in 1282 bytes} [Wed Dec 15 16:14:24 2021] POST /compute/v2.1/flavors => generated 402 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:14:24.417018 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi [None req-1b28f178-a67c-4955-b55d-cf62fdaf857d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:24.450158 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: INFO nova.api.openstack.requestlog [None req-1b28f178-a67c-4955-b55d-cf62fdaf857d admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038538 Dec 15 16:14:24.451292 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: [pid: 101874|app: 0|req: 11/23] 10.222.0.60 () {64 vars in 1332 bytes} [Wed Dec 15 16:14:24 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:27.387973 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi [None req-bdb47283-33f1-4f7c-9eb4-78b1b961b246 admin admin] Calling method '>' {{(pid=101875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:27.388974 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: INFO nova.api.openstack.requestlog [None req-bdb47283-33f1-4f7c-9eb4-78b1b961b246 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001561 Dec 15 16:14:27.389373 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: [pid: 101875|app: 0|req: 13/24] 10.222.0.60 () {54 vars in 930 bytes} [Wed Dec 15 16:14:27 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:14:27.466897 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi [None req-f0b6bc8e-6d02-4ae9-aee4-0a9415543c61 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 2048, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "id": "2", "disk": 20}} {{(pid=101874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:27.499584 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: INFO nova.api.openstack.requestlog [None req-f0b6bc8e-6d02-4ae9-aee4-0a9415543c61 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.102207 Dec 15 16:14:27.500963 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: [pid: 101874|app: 0|req: 12/25] 10.222.0.60 () {64 vars in 1282 bytes} [Wed Dec 15 16:14:27 2021] POST /compute/v2.1/flavors => generated 405 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:14:27.519298 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi [None req-d211983a-89bf-4cfa-a2fa-0c8349b3f061 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:27.551220 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: INFO nova.api.openstack.requestlog [None req-d211983a-89bf-4cfa-a2fa-0c8349b3f061 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036549 Dec 15 16:14:27.552230 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: [pid: 101875|app: 0|req: 14/26] 10.222.0.60 () {64 vars in 1332 bytes} [Wed Dec 15 16:14:27 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:30.065488 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi [None req-f0b6bc8e-6d02-4ae9-aee4-0a9415543c61 admin admin] Calling method '>' {{(pid=101874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:30.067228 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: INFO nova.api.openstack.requestlog [None req-f0b6bc8e-6d02-4ae9-aee4-0a9415543c61 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002939 Dec 15 16:14:30.067677 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: [pid: 101874|app: 0|req: 13/27] 10.222.0.60 () {54 vars in 930 bytes} [Wed Dec 15 16:14:30 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:14:30.140925 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi [None req-1c3b41fb-bb88-491d-be13-43ea5cdf939a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 2, "name": "m1.medium", "os-flavor-access:is_public": true, "disk": 40, "id": "3", "ram": 4096}} {{(pid=101875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:30.162074 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: INFO nova.api.openstack.requestlog [None req-1c3b41fb-bb88-491d-be13-43ea5cdf939a admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.085905 Dec 15 16:14:30.162637 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: [pid: 101875|app: 0|req: 15/28] 10.222.0.60 () {64 vars in 1282 bytes} [Wed Dec 15 16:14:30 2021] POST /compute/v2.1/flavors => generated 406 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:14:30.177372 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi [None req-0ad5b1de-1b12-48c7-afb1-9eee2aca0168 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:30.225756 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: INFO nova.api.openstack.requestlog [None req-0ad5b1de-1b12-48c7-afb1-9eee2aca0168 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.053555 Dec 15 16:14:30.226849 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: [pid: 101874|app: 0|req: 14/29] 10.222.0.60 () {64 vars in 1332 bytes} [Wed Dec 15 16:14:30 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:14:32.819333 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi [None req-1c3b41fb-bb88-491d-be13-43ea5cdf939a admin admin] Calling method '>' {{(pid=101875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:32.821424 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: INFO nova.api.openstack.requestlog [None req-1c3b41fb-bb88-491d-be13-43ea5cdf939a admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003122 Dec 15 16:14:32.822076 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: [pid: 101875|app: 0|req: 16/30] 10.222.0.60 () {54 vars in 930 bytes} [Wed Dec 15 16:14:32 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:14:32.887962 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi [None req-c38a31c0-df08-4819-9ea5-d079d911053f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.large", "ram": 8192, "disk": 80, "id": "4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 4}} {{(pid=101874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:32.909407 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: INFO nova.api.openstack.requestlog [None req-c38a31c0-df08-4819-9ea5-d079d911053f admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.079841 Dec 15 16:14:32.917035 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: [pid: 101874|app: 0|req: 15/31] 10.222.0.60 () {64 vars in 1282 bytes} [Wed Dec 15 16:14:32 2021] POST /compute/v2.1/flavors => generated 405 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:14:32.923086 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi [None req-1bd0db03-7db1-479b-8b68-de8630904c84 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:32.947589 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: INFO nova.api.openstack.requestlog [None req-1bd0db03-7db1-479b-8b68-de8630904c84 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028627 Dec 15 16:14:32.948165 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: [pid: 101875|app: 0|req: 17/32] 10.222.0.60 () {64 vars in 1332 bytes} [Wed Dec 15 16:14:32 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:35.562593 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi [None req-c38a31c0-df08-4819-9ea5-d079d911053f admin admin] Calling method '>' {{(pid=101874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:35.564151 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: INFO nova.api.openstack.requestlog [None req-c38a31c0-df08-4819-9ea5-d079d911053f admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002186 Dec 15 16:14:35.564616 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: [pid: 101874|app: 0|req: 16/33] 10.222.0.60 () {54 vars in 930 bytes} [Wed Dec 15 16:14:35 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:14:35.635272 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi [None req-9a39fe62-ba99-410d-b6d5-b1d74548c83e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "id": "5", "rxtx_factor": 1.0, "swap": 0, "name": "m1.xlarge", "disk": 160, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8}} {{(pid=101875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:35.662368 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: INFO nova.api.openstack.requestlog [None req-9a39fe62-ba99-410d-b6d5-b1d74548c83e admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.089976 Dec 15 16:14:35.664267 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: [pid: 101875|app: 0|req: 18/34] 10.222.0.60 () {64 vars in 1282 bytes} [Wed Dec 15 16:14:35 2021] POST /compute/v2.1/flavors => generated 408 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:14:35.678510 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi [None req-add3abaa-b572-43e6-9eb6-57c02375d67c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:14:35.707054 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: INFO nova.api.openstack.requestlog [None req-add3abaa-b572-43e6-9eb6-57c02375d67c admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031766 Dec 15 16:14:35.708380 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: [pid: 101874|app: 0|req: 17/35] 10.222.0.60 () {64 vars in 1332 bytes} [Wed Dec 15 16:14:35 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:14:56.169420 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi [None req-9a39fe62-ba99-410d-b6d5-b1d74548c83e admin admin] Calling method '>' {{(pid=101875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:56.170471 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: INFO nova.api.openstack.requestlog [None req-9a39fe62-ba99-410d-b6d5-b1d74548c83e admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Dec 15 16:14:56.170867 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: [pid: 101875|app: 0|req: 19/36] 10.222.0.60 () {54 vars in 930 bytes} [Wed Dec 15 16:14:56 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:14:56.237863 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi [None req-866c2118-bbfd-43dc-ae4f-79265bf6b23b admin admin] Calling method '>' {{(pid=101874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:56.257207 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: INFO nova.api.openstack.requestlog [None req-866c2118-bbfd-43dc-ae4f-79265bf6b23b admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.079236 Dec 15 16:14:56.257739 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: [pid: 101874|app: 0|req: 18/37] 10.222.0.60 () {60 vars in 1291 bytes} [Wed Dec 15 16:14:56 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:14:57.893446 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi [None req-9a39fe62-ba99-410d-b6d5-b1d74548c83e admin admin] Calling method '>' {{(pid=101875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:57.894527 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: INFO nova.api.openstack.requestlog [None req-9a39fe62-ba99-410d-b6d5-b1d74548c83e admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001758 Dec 15 16:14:57.895009 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: [pid: 101875|app: 0|req: 20/38] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Dec 15 16:14:57 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:14:58.094945 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi [None req-ec7d9cfa-d3b0-4fe1-9d0e-9ffadfd12b70 admin admin] Calling method '>' {{(pid=101874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:58.100958 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: INFO nova.api.openstack.wsgi [None req-ec7d9cfa-d3b0-4fe1-9d0e-9ffadfd12b70 admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 15 16:14:58.101537 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi [None req-ec7d9cfa-d3b0-4fe1-9d0e-9ffadfd12b70 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:14:58.102660 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: INFO nova.api.openstack.requestlog [None req-ec7d9cfa-d3b0-4fe1-9d0e-9ffadfd12b70 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.064728 Dec 15 16:14:58.103203 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: [pid: 101874|app: 0|req: 19/39] 10.222.0.60 () {60 vars in 1190 bytes} [Wed Dec 15 16:14:58 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 16:14:58.113377 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi [None req-dbf97138-59a8-4c10-bb00-f0b5ce812e9b admin admin] Calling method '>' {{(pid=101875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:58.134604 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: INFO nova.api.openstack.requestlog [None req-dbf97138-59a8-4c10-bb00-f0b5ce812e9b admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024860 Dec 15 16:14:58.135176 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: [pid: 101875|app: 0|req: 21/40] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Dec 15 16:14:58 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:14:58.146427 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi [None req-39ac1886-ceef-4b84-9743-90f8f1ea34b7 admin admin] Calling method '>' {{(pid=101874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:58.167670 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: INFO nova.api.openstack.requestlog [None req-39ac1886-ceef-4b84-9743-90f8f1ea34b7 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024876 Dec 15 16:14:58.168218 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: [pid: 101874|app: 0|req: 20/41] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Dec 15 16:14:58 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:14:58.179149 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi [None req-8c8ce060-f787-460e-adc4-fdfd2166f65d admin admin] Calling method '>' {{(pid=101875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:58.184935 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: INFO nova.api.openstack.wsgi [None req-8c8ce060-f787-460e-adc4-fdfd2166f65d admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 15 16:14:58.185552 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi [None req-8c8ce060-f787-460e-adc4-fdfd2166f65d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:14:58.186257 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: INFO nova.api.openstack.requestlog [None req-8c8ce060-f787-460e-adc4-fdfd2166f65d admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010770 Dec 15 16:14:58.186785 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: [pid: 101875|app: 0|req: 22/42] 10.222.0.60 () {60 vars in 1190 bytes} [Wed Dec 15 16:14:58 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 16:14:59.675542 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi [None req-39ac1886-ceef-4b84-9743-90f8f1ea34b7 admin admin] Calling method '>' {{(pid=101874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:59.676575 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: INFO nova.api.openstack.requestlog [None req-39ac1886-ceef-4b84-9743-90f8f1ea34b7 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Dec 15 16:14:59.676994 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: [pid: 101874|app: 0|req: 21/43] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Dec 15 16:14:59 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:14:59.881596 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi [None req-c38fcc56-a5f4-44ce-905c-3bb6453c54c5 admin admin] Calling method '>' {{(pid=101875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:59.887794 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: INFO nova.api.openstack.wsgi [None req-c38fcc56-a5f4-44ce-905c-3bb6453c54c5 admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 15 16:14:59.888368 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi [None req-c38fcc56-a5f4-44ce-905c-3bb6453c54c5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:14:59.889338 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: INFO nova.api.openstack.requestlog [None req-c38fcc56-a5f4-44ce-905c-3bb6453c54c5 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.070317 Dec 15 16:14:59.889872 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: [pid: 101875|app: 0|req: 23/44] 10.222.0.60 () {60 vars in 1190 bytes} [Wed Dec 15 16:14:59 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 16:14:59.900077 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi [None req-9d9ed163-0d78-459b-916b-b0171bf3510d admin admin] Calling method '>' {{(pid=101874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:59.914638 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: INFO nova.api.openstack.requestlog [None req-9d9ed163-0d78-459b-916b-b0171bf3510d admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017996 Dec 15 16:14:59.915195 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: [pid: 101874|app: 0|req: 22/45] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Dec 15 16:14:59 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:14:59.926404 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi [None req-9cdde874-eab5-47cc-93e3-540bd6a7fefc admin admin] Calling method '>' {{(pid=101875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:59.941955 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: INFO nova.api.openstack.requestlog [None req-9cdde874-eab5-47cc-93e3-540bd6a7fefc admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019798 Dec 15 16:14:59.942792 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: [pid: 101875|app: 0|req: 24/46] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Dec 15 16:14:59 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:14:59.953557 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi [None req-53325769-179f-466d-8552-71dadd72684c admin admin] Calling method '>' {{(pid=101874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:14:59.959241 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: INFO nova.api.openstack.wsgi [None req-53325769-179f-466d-8552-71dadd72684c admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 15 16:14:59.959848 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi [None req-53325769-179f-466d-8552-71dadd72684c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:14:59.960642 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: INFO nova.api.openstack.requestlog [None req-53325769-179f-466d-8552-71dadd72684c admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010903 Dec 15 16:14:59.961170 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: [pid: 101874|app: 0|req: 23/47] 10.222.0.60 () {60 vars in 1190 bytes} [Wed Dec 15 16:14:59 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Dec 15 16:15:01.495760 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi [None req-9cdde874-eab5-47cc-93e3-540bd6a7fefc admin admin] Calling method '>' {{(pid=101875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:01.496759 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: INFO nova.api.openstack.requestlog [None req-9cdde874-eab5-47cc-93e3-540bd6a7fefc admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Dec 15 16:15:01.497153 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: [pid: 101875|app: 0|req: 25/48] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Dec 15 16:15:01 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:15:01.701186 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi [None req-b229a495-f67c-49c1-9650-fce76c5ec9b8 admin admin] Calling method '>' {{(pid=101874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:01.707330 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: INFO nova.api.openstack.wsgi [None req-b229a495-f67c-49c1-9650-fce76c5ec9b8 admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 15 16:15:01.707917 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi [None req-b229a495-f67c-49c1-9650-fce76c5ec9b8 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:15:01.708703 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: INFO nova.api.openstack.requestlog [None req-b229a495-f67c-49c1-9650-fce76c5ec9b8 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.062284 Dec 15 16:15:01.709236 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: [pid: 101874|app: 0|req: 24/49] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Dec 15 16:15:01 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 16:15:01.719311 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi [None req-4b8ba330-d2e6-4c15-976d-be0fde883ec9 admin admin] Calling method '>' {{(pid=101875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:01.735973 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: INFO nova.api.openstack.requestlog [None req-4b8ba330-d2e6-4c15-976d-be0fde883ec9 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019583 Dec 15 16:15:01.736604 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: [pid: 101875|app: 0|req: 26/50] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Dec 15 16:15:01 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:15:01.750134 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi [None req-439b0506-f7e9-4547-91d8-d307fe711533 admin admin] Calling method '>' {{(pid=101874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:01.769321 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: INFO nova.api.openstack.requestlog [None req-439b0506-f7e9-4547-91d8-d307fe711533 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025444 Dec 15 16:15:01.769959 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: [pid: 101874|app: 0|req: 25/51] 10.222.0.60 () {60 vars in 1210 bytes} [Wed Dec 15 16:15:01 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:15:01.781033 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi [None req-78065f34-cf6c-42c0-9a0e-99f6a95b11fe admin admin] Calling method '>' {{(pid=101875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:01.787476 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: INFO nova.api.openstack.wsgi [None req-78065f34-cf6c-42c0-9a0e-99f6a95b11fe admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 15 16:15:01.788047 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi [None req-78065f34-cf6c-42c0-9a0e-99f6a95b11fe admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101875) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:15:01.789047 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: INFO nova.api.openstack.requestlog [None req-78065f34-cf6c-42c0-9a0e-99f6a95b11fe admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011474 Dec 15 16:15:01.789467 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: [pid: 101875|app: 0|req: 27/52] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Dec 15 16:15:01 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 15 16:15:03.307348 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi [None req-439b0506-f7e9-4547-91d8-d307fe711533 admin admin] Calling method '>' {{(pid=101874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:03.308390 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: INFO nova.api.openstack.requestlog [None req-439b0506-f7e9-4547-91d8-d307fe711533 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Dec 15 16:15:03.308784 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: [pid: 101874|app: 0|req: 26/53] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Dec 15 16:15:03 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:15:03.505582 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi [None req-758f2f91-1d1f-4802-aeb0-b05a4f00617f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:03.526806 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: INFO nova.api.openstack.requestlog [None req-758f2f91-1d1f-4802-aeb0-b05a4f00617f admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.079442 Dec 15 16:15:03.527260 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: [pid: 101875|app: 0|req: 28/54] 10.222.0.60 () {64 vars in 1235 bytes} [Wed Dec 15 16:15:03 2021] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:15:05.068941 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi [None req-439b0506-f7e9-4547-91d8-d307fe711533 admin admin] Calling method '>' {{(pid=101874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:05.069945 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: INFO nova.api.openstack.requestlog [None req-439b0506-f7e9-4547-91d8-d307fe711533 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Dec 15 16:15:05.070310 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: [pid: 101874|app: 0|req: 27/55] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Dec 15 16:15:05 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:15:05.269259 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi [None req-c75d3661-943b-4e1e-af8f-361e4ed4ecfd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:05.289140 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: INFO nova.api.openstack.requestlog [None req-c75d3661-943b-4e1e-af8f-361e4ed4ecfd admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.079935 Dec 15 16:15:05.289647 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: [pid: 101875|app: 0|req: 29/56] 10.222.0.60 () {64 vars in 1235 bytes} [Wed Dec 15 16:15:05 2021] POST /compute/v2.1/flavors => generated 405 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:15:06.813627 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi [None req-439b0506-f7e9-4547-91d8-d307fe711533 admin admin] Calling method '>' {{(pid=101874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:06.814757 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: INFO nova.api.openstack.requestlog [None req-439b0506-f7e9-4547-91d8-d307fe711533 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 Dec 15 16:15:06.815186 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: [pid: 101874|app: 0|req: 28/57] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Dec 15 16:15:06 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:15:07.009378 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi [None req-55bf770e-26a8-49b9-9ebc-bfdcb7fef58b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:07.029801 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: INFO nova.api.openstack.requestlog [None req-55bf770e-26a8-49b9-9ebc-bfdcb7fef58b admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.075125 Dec 15 16:15:07.030263 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: [pid: 101875|app: 0|req: 30/58] 10.222.0.60 () {64 vars in 1235 bytes} [Wed Dec 15 16:15:06 2021] POST /compute/v2.1/flavors => generated 407 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:15:08.557476 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi [None req-439b0506-f7e9-4547-91d8-d307fe711533 admin admin] Calling method '>' {{(pid=101874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:08.558596 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: INFO nova.api.openstack.requestlog [None req-439b0506-f7e9-4547-91d8-d307fe711533 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001616 Dec 15 16:15:08.559057 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: [pid: 101874|app: 0|req: 29/59] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Dec 15 16:15:08 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:15:08.756561 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi [None req-3c928607-2719-4600-a39e-2ac4f82fd139 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:15:08.777566 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: INFO nova.api.openstack.requestlog [None req-3c928607-2719-4600-a39e-2ac4f82fd139 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.076779 Dec 15 16:15:08.778113 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: [pid: 101875|app: 0|req: 31/60] 10.222.0.60 () {64 vars in 1235 bytes} [Wed Dec 15 16:15:08 2021] POST /compute/v2.1/flavors => generated 409 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:15:10.287053 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi [None req-439b0506-f7e9-4547-91d8-d307fe711533 admin admin] Calling method '>' {{(pid=101874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:10.288092 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: INFO nova.api.openstack.requestlog [None req-439b0506-f7e9-4547-91d8-d307fe711533 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Dec 15 16:15:10.288485 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: [pid: 101874|app: 0|req: 30/61] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Dec 15 16:15:10 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:15:10.486089 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi [None req-f86bd270-afff-4e92-a5cd-0278513145f4 admin admin] Calling method '>' {{(pid=101875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:10.505283 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: INFO nova.api.openstack.requestlog [None req-f86bd270-afff-4e92-a5cd-0278513145f4 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.076801 Dec 15 16:15:10.505716 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: [pid: 101875|app: 0|req: 32/62] 10.222.0.60 () {60 vars in 1202 bytes} [Wed Dec 15 16:15:10 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:15:59.311224 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi [None req-439b0506-f7e9-4547-91d8-d307fe711533 admin admin] Calling method '>' {{(pid=101874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:59.312291 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: INFO nova.api.openstack.requestlog [None req-439b0506-f7e9-4547-91d8-d307fe711533 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Dec 15 16:15:59.312693 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: [pid: 101874|app: 0|req: 31/63] 10.222.0.60 () {54 vars in 930 bytes} [Wed Dec 15 16:15:59 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:15:59.373448 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi [None req-af871260-5963-49db-99cc-90c521dbe964 admin admin] Calling method '>' {{(pid=101875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:59.392482 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: INFO nova.api.openstack.requestlog [None req-af871260-5963-49db-99cc-90c521dbe964 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.072698 Dec 15 16:15:59.393025 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: [pid: 101875|app: 0|req: 33/64] 10.222.0.60 () {60 vars in 1291 bytes} [Wed Dec 15 16:15:59 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:15:59.415499 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi [None req-b03c75f0-99fc-4b02-bd45-a4837ce5c302 admin admin] Calling method '>' {{(pid=101874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:59.423638 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: INFO nova.api.openstack.requestlog [None req-b03c75f0-99fc-4b02-bd45-a4837ce5c302 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011697 Dec 15 16:15:59.424164 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: [pid: 101874|app: 0|req: 32/65] 10.222.0.60 () {60 vars in 1282 bytes} [Wed Dec 15 16:15:59 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:59.436930 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi [None req-b01931ef-5c3a-4819-a864-264941482bda admin admin] Calling method '>' {{(pid=101875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:59.445357 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: INFO nova.api.openstack.requestlog [None req-b01931ef-5c3a-4819-a864-264941482bda admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012083 Dec 15 16:15:59.445893 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: [pid: 101875|app: 0|req: 34/66] 10.222.0.60 () {60 vars in 1285 bytes} [Wed Dec 15 16:15:59 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:59.457708 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi [None req-19a23008-93db-4ef2-8a28-a2de29413870 admin admin] Calling method '>' {{(pid=101874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:59.465928 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: INFO nova.api.openstack.requestlog [None req-19a23008-93db-4ef2-8a28-a2de29413870 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011872 Dec 15 16:15:59.466478 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: [pid: 101874|app: 0|req: 33/67] 10.222.0.60 () {60 vars in 1285 bytes} [Wed Dec 15 16:15:59 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:15:59.478301 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi [None req-b6dee22c-4107-4581-b33e-c507ef850929 admin admin] Calling method '>' {{(pid=101875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:15:59.486967 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: INFO nova.api.openstack.requestlog [None req-b6dee22c-4107-4581-b33e-c507ef850929 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012185 Dec 15 16:15:59.487528 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: [pid: 101875|app: 0|req: 35/68] 10.222.0.60 () {60 vars in 1282 bytes} [Wed Dec 15 16:15:59 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:17:25.086875 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi [None req-359ec685-67b8-49ae-a417-34fe94e9d4cc tempest-verify_tempest_config-1953617747 tempest-verify_tempest_config-1953617747-project] Calling method '>' {{(pid=101874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:17:25.088901 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: INFO nova.api.openstack.requestlog [None req-359ec685-67b8-49ae-a417-34fe94e9d4cc tempest-verify_tempest_config-1953617747 tempest-verify_tempest_config-1953617747-project] 10.222.0.60 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.113450 Dec 15 16:17:25.089437 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: [pid: 101874|app: 0|req: 34/69] 10.222.0.60 () {58 vars in 1133 bytes} [Wed Dec 15 16:17:24 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:18:55.813393 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi [None req-b6dee22c-4107-4581-b33e-c507ef850929 admin admin] Calling method '>' {{(pid=101875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:18:55.814390 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: INFO nova.api.openstack.requestlog [None req-b6dee22c-4107-4581-b33e-c507ef850929 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Dec 15 16:18:55.814813 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: [pid: 101875|app: 0|req: 36/70] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Dec 15 16:18:55 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:18:56.114935 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi [None req-0d0d3946-ef58-47c0-bf8b-7d2bc876b76b admin admin] Calling method '>' {{(pid=101874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:18:56.116132 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:18:56.116132 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: warnings.warn(msg) Dec 15 16:18:56.117748 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG oslo_concurrency.lockutils [None req-0d0d3946-ef58-47c0-bf8b-7d2bc876b76b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:56.118187 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG oslo_concurrency.lockutils [None req-0d0d3946-ef58-47c0-bf8b-7d2bc876b76b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:56.118982 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG oslo_concurrency.lockutils [None req-0d0d3946-ef58-47c0-bf8b-7d2bc876b76b admin admin] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:56.119523 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG oslo_concurrency.lockutils [None req-0d0d3946-ef58-47c0-bf8b-7d2bc876b76b admin admin] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:56.154206 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: INFO nova.api.openstack.requestlog [None req-0d0d3946-ef58-47c0-bf8b-7d2bc876b76b admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.194788 Dec 15 16:18:56.154712 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: [pid: 101874|app: 0|req: 35/71] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Dec 15 16:18:55 2021] GET /compute/v2.1/os-services => generated 791 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:18:57.664113 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi [None req-b6dee22c-4107-4581-b33e-c507ef850929 admin admin] Calling method '>' {{(pid=101875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:18:57.665154 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: INFO nova.api.openstack.requestlog [None req-b6dee22c-4107-4581-b33e-c507ef850929 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Dec 15 16:18:57.665573 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: [pid: 101875|app: 0|req: 37/72] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Dec 15 16:18:57 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:18:57.870251 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi [None req-bc98216c-ace3-4398-b8f2-2fc9b29212df admin admin] Calling method '>' {{(pid=101874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:18:57.871971 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:18:57.871971 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: warnings.warn(msg) Dec 15 16:18:57.873515 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG oslo_concurrency.lockutils [None req-bc98216c-ace3-4398-b8f2-2fc9b29212df admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:57.874284 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG oslo_concurrency.lockutils [None req-bc98216c-ace3-4398-b8f2-2fc9b29212df admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:57.875082 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG oslo_concurrency.lockutils [None req-bc98216c-ace3-4398-b8f2-2fc9b29212df admin admin] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:18:57.875545 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG oslo_concurrency.lockutils [None req-bc98216c-ace3-4398-b8f2-2fc9b29212df admin admin] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:18:57.900263 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: INFO nova.api.openstack.requestlog [None req-bc98216c-ace3-4398-b8f2-2fc9b29212df admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.091811 Dec 15 16:18:57.900853 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: [pid: 101874|app: 0|req: 36/73] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Dec 15 16:18:57 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:19:09.866178 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi [None req-b6dee22c-4107-4581-b33e-c507ef850929 admin admin] Calling method '>' {{(pid=101875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:19:09.867210 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: INFO nova.api.openstack.requestlog [None req-b6dee22c-4107-4581-b33e-c507ef850929 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Dec 15 16:19:09.867627 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: [pid: 101875|app: 0|req: 38/74] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Dec 15 16:19:09 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:19:10.064509 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi [None req-bb27a6b1-e975-441d-b152-d479aafb2721 admin admin] Calling method '>' {{(pid=101874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:19:10.065677 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:19:10.065677 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: warnings.warn(msg) Dec 15 16:19:10.067202 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG oslo_concurrency.lockutils [None req-bb27a6b1-e975-441d-b152-d479aafb2721 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:10.067738 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG oslo_concurrency.lockutils [None req-bb27a6b1-e975-441d-b152-d479aafb2721 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:10.068795 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG oslo_concurrency.lockutils [None req-bb27a6b1-e975-441d-b152-d479aafb2721 admin admin] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:10.069439 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG oslo_concurrency.lockutils [None req-bb27a6b1-e975-441d-b152-d479aafb2721 admin admin] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:10.095657 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: INFO nova.api.openstack.requestlog [None req-bb27a6b1-e975-441d-b152-d479aafb2721 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.088482 Dec 15 16:19:10.096429 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: [pid: 101874|app: 0|req: 37/75] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Dec 15 16:19:10 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:19:11.630493 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: DEBUG nova.api.openstack.wsgi [None req-b6dee22c-4107-4581-b33e-c507ef850929 admin admin] Calling method '>' {{(pid=101875) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:19:11.631521 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: INFO nova.api.openstack.requestlog [None req-b6dee22c-4107-4581-b33e-c507ef850929 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Dec 15 16:19:11.631936 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: [pid: 101875|app: 0|req: 39/76] 10.222.0.60 () {56 vars in 1074 bytes} [Wed Dec 15 16:19:11 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:19:11.826401 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG nova.api.openstack.wsgi [None req-3842bfde-c29c-4217-a556-13620781f358 admin admin] Calling method '>' {{(pid=101874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:19:11.827613 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:19:11.827613 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: warnings.warn(msg) Dec 15 16:19:11.829248 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG oslo_concurrency.lockutils [None req-3842bfde-c29c-4217-a556-13620781f358 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:11.829678 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG oslo_concurrency.lockutils [None req-3842bfde-c29c-4217-a556-13620781f358 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:11.830460 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG oslo_concurrency.lockutils [None req-3842bfde-c29c-4217-a556-13620781f358 admin admin] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:19:11.830872 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: DEBUG oslo_concurrency.lockutils [None req-3842bfde-c29c-4217-a556-13620781f358 admin admin] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:19:11.851907 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: INFO nova.api.openstack.requestlog [None req-3842bfde-c29c-4217-a556-13620781f358 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.081620 Dec 15 16:19:11.852389 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: [pid: 101874|app: 0|req: 38/77] 10.222.0.60 () {60 vars in 1193 bytes} [Wed Dec 15 16:19:11 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:20:10.576952 dv-cinder-812685-4-iscsi devstack@n-api.service[101873]: Wed Dec 15 16:20:10 2021 - graceful shutdown triggered... Dec 15 16:20:10.577755 dv-cinder-812685-4-iscsi devstack@n-api.service[101875]: Gracefully killing worker 2 (pid: 101875)... Dec 15 16:20:10.578335 dv-cinder-812685-4-iscsi devstack@n-api.service[101874]: Gracefully killing worker 1 (pid: 101874)... Dec 15 16:20:10.579869 dv-cinder-812685-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Dec 15 16:20:11.578181 dv-cinder-812685-4-iscsi devstack@n-api.service[101873]: worker 1 buried after 1 seconds Dec 15 16:20:11.578181 dv-cinder-812685-4-iscsi devstack@n-api.service[101873]: worker 2 buried after 1 seconds Dec 15 16:20:11.578181 dv-cinder-812685-4-iscsi devstack@n-api.service[101873]: goodbye to uWSGI. Dec 15 16:20:11.579929 dv-cinder-812685-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Dec 15 16:20:11.580694 dv-cinder-812685-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Dec 15 16:20:11.584268 dv-cinder-812685-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 15 16:20:11.594074 dv-cinder-812685-4-iscsi devstack@n-api.service[116066]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 15 16:20:11.596225 dv-cinder-812685-4-iscsi devstack@n-api.service[116066]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Dec 15 16:20:11 2021] *** Dec 15 16:20:11.596225 dv-cinder-812685-4-iscsi devstack@n-api.service[116066]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 15 16:20:11.596225 dv-cinder-812685-4-iscsi devstack@n-api.service[116066]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 15 16:20:11.596225 dv-cinder-812685-4-iscsi devstack@n-api.service[116066]: nodename: dv-cinder-812685-4-iscsi Dec 15 16:20:11.596225 dv-cinder-812685-4-iscsi devstack@n-api.service[116066]: machine: x86_64 Dec 15 16:20:11.596225 dv-cinder-812685-4-iscsi devstack@n-api.service[116066]: clock source: unix Dec 15 16:20:11.596225 dv-cinder-812685-4-iscsi devstack@n-api.service[116066]: pcre jit disabled Dec 15 16:20:11.596225 dv-cinder-812685-4-iscsi devstack@n-api.service[116066]: detected number of CPU cores: 4 Dec 15 16:20:11.596225 dv-cinder-812685-4-iscsi devstack@n-api.service[116066]: current working directory: / Dec 15 16:20:11.596225 dv-cinder-812685-4-iscsi devstack@n-api.service[116066]: detected binary path: /usr/bin/uwsgi-core Dec 15 16:20:11.596225 dv-cinder-812685-4-iscsi devstack@n-api.service[116066]: your processes number limit is 47680 Dec 15 16:20:11.596972 dv-cinder-812685-4-iscsi devstack@n-api.service[116066]: your memory page size is 4096 bytes Dec 15 16:20:11.596972 dv-cinder-812685-4-iscsi devstack@n-api.service[116066]: detected max file descriptor number: 2048 Dec 15 16:20:11.596972 dv-cinder-812685-4-iscsi devstack@n-api.service[116066]: lock engine: pthread robust mutexes Dec 15 16:20:11.596972 dv-cinder-812685-4-iscsi devstack@n-api.service[116066]: thunder lock: enabled Dec 15 16:20:11.596972 dv-cinder-812685-4-iscsi devstack@n-api.service[116066]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 15 16:20:11.596972 dv-cinder-812685-4-iscsi devstack@n-api.service[116066]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Dec 15 16:20:11.643207 dv-cinder-812685-4-iscsi devstack@n-api.service[116066]: Python main interpreter initialized at 0x55ca9dc7c9c0 Dec 15 16:20:11.643207 dv-cinder-812685-4-iscsi devstack@n-api.service[116066]: python threads support enabled Dec 15 16:20:11.643207 dv-cinder-812685-4-iscsi devstack@n-api.service[116066]: your server socket listen backlog is limited to 100 connections Dec 15 16:20:11.643207 dv-cinder-812685-4-iscsi devstack@n-api.service[116066]: your mercy for graceful operations on workers is 90 seconds Dec 15 16:20:11.643705 dv-cinder-812685-4-iscsi devstack@n-api.service[116066]: mapped 403077 bytes (393 KB) for 2 cores Dec 15 16:20:11.643705 dv-cinder-812685-4-iscsi devstack@n-api.service[116066]: *** Operational MODE: preforking *** Dec 15 16:20:11.643982 dv-cinder-812685-4-iscsi devstack@n-api.service[116066]: *** uWSGI is running in multiple interpreter mode *** Dec 15 16:20:11.643982 dv-cinder-812685-4-iscsi devstack@n-api.service[116066]: spawned uWSGI master process (pid: 116066) Dec 15 16:20:11.644204 dv-cinder-812685-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 15 16:20:11.645315 dv-cinder-812685-4-iscsi devstack@n-api.service[116066]: spawned uWSGI worker 1 (pid: 116084, cores: 1) Dec 15 16:20:11.645315 dv-cinder-812685-4-iscsi devstack@n-api.service[116066]: spawned uWSGI worker 2 (pid: 116085, cores: 1) Dec 15 16:20:11.645315 dv-cinder-812685-4-iscsi devstack@n-api.service[116066]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 15 16:20:13.555449 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 16:20:13.555449 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: from cryptography.utils import int_from_bytes Dec 15 16:20:13.556203 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 16:20:13.556203 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: from cryptography.utils import int_from_bytes Dec 15 16:20:13.577473 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 16:20:13.577473 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: from cryptography.utils import int_from_bytes Dec 15 16:20:13.577473 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 15 16:20:13.577473 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: from cryptography.utils import int_from_bytes Dec 15 16:20:16.029169 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 16:20:16.029739 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 16:20:16.029998 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 16:20:16.030307 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 16:20:16.030553 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 16:20:16.030926 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.031266 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.031629 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.031949 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.032263 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.032591 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.032907 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.033224 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.033555 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.033815 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.034022 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 15 16:20:16.034418 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.034509 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 15 16:20:16.034598 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-812685-4-iscsi {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.034806 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.034900 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 15 16:20:16.035073 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.035174 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 15 16:20:16.035340 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.035469 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 15 16:20:16.035663 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.035824 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.035975 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.036142 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.036298 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.036448 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.036599 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.036755 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.037093 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.037239 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.037407 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.038730 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.039063 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.039525 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.039845 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.040064 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.040266 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.040467 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.040678 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.040892 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.041111 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.041338 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-812685-4-iscsi {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.041556 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.041755 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.041966 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.042172 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.042383 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.042594 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.042793 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.043005 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.043206 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.043525 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.043750 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-812685-4-iscsi {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.043944 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.044119 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.044316 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.044479 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.044479 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.044796 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.044956 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.045104 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.045260 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.045399 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.045580 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.045732 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.045876 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.046015 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.046161 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.046300 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.046444 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.046581 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.046718 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.046893 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.047068 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.047224 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.047400 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.047564 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.047726 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.047872 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.048026 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.049582 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-812685-4-iscsi {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.049744 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.049902 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.050052 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.050202 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.050349 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.050489 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.050634 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.050780 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.050921 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.051082 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.051221 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.051405 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.051552 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.051701 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.051853 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.052001 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.052150 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.053103 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.053271 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.053426 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.053581 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.053804 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.053952 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.054225 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.054405 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.054641 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.054903 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.055135 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.055352 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.055603 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.055753 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.055908 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.056047 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.056198 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.056338 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.056476 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.056620 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.056772 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.056772 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.057048 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.057186 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.057335 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.057473 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.057623 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.057762 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.057921 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.058079 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.058231 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.058816 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.058974 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.059122 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.059273 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.059430 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.059583 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.059733 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.059878 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.060016 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.060173 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.060312 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.060459 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.060603 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.060749 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.060888 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.061031 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.061176 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.061327 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.061476 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.061621 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.061767 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.061906 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.062063 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.062216 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.062365 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.062513 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.062653 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.063004 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.063361 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.063598 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.063739 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.063883 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.064029 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.064167 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.064325 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.064464 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.064612 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.064751 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.064895 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.065034 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.065180 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.065319 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.065456 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.065594 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.065732 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.065878 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.066024 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.066173 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.066318 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.066465 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.066610 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.066758 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.066906 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.067043 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.067181 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.067318 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.067487 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.067628 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.067775 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.067913 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.068060 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.068197 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.068333 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.068504 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.069004 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.069158 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.069297 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.070850 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.071022 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.071175 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.071325 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.071325 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.071649 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.071804 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.071951 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.072098 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.072236 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.072381 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.072530 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.072676 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.072814 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.073184 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.073618 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.073776 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.073924 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.074090 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.074243 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.074395 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.074541 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.074688 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.074835 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.074981 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.075134 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.075273 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.075471 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.075630 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.075777 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.075917 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.076079 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.076222 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.076373 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.076512 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.076657 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.076814 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.076954 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.077102 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.077243 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.077389 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.077527 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.077665 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.077822 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.077968 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.078114 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.078261 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.078407 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.078552 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.078691 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.079318 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.079510 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.079666 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.079813 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.079960 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.080106 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.080310 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.080469 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.080616 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.080761 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.080899 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.081045 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.081198 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.081337 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.081475 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.081863 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.082027 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.082179 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.082329 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.082486 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.082634 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.082781 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.082920 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.083347 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.083554 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.083554 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.084093 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.084234 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.084333 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.084515 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.084660 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.084800 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.084948 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.085091 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.085227 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.085534 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.085770 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.085917 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.086073 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.086245 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.086380 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.086532 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.086675 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.086817 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 15 16:20:16.086970 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.087115 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.087262 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.087492 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.087645 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.087823 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.087923 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.088007 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.088095 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.088190 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.088273 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.088362 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.088443 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.088571 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.088665 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.088760 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.088860 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.089002 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.089384 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.089494 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.089585 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.089731 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.089830 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.089920 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.090002 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.090083 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.090169 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.090259 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.090349 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.090438 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.090519 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.090606 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.090687 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.090776 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.090864 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.090952 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.091040 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.091128 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.091210 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.091298 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.091403 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.091498 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.091587 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.091670 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.091751 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.091833 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.091912 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.091998 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.092169 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.092261 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.092396 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.092396 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.092562 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.092562 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.092717 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.092796 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.092878 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.093032 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.093119 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.093200 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.093352 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.093477 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.093575 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.093665 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.093765 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.093902 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.093995 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.094091 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.094173 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.094254 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.094333 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.094411 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.094490 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.094578 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.094660 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.094740 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.094818 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.094897 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.094986 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.095074 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.095166 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.095248 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.095332 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.095661 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.095761 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.095859 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.095943 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.096023 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.096110 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.096192 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.096285 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.096367 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.096457 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.096546 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.096635 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.096724 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.096893 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.096984 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.097072 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.097160 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.097248 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.097336 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.097426 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.097507 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.097593 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.097687 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.097768 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.097856 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.097944 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.098033 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.098114 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.098201 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.098290 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.098384 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.098466 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.098545 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.098624 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.098703 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.098790 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.098889 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.098972 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.099060 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.099222 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.099363 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.099612 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.099711 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.099801 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.099889 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.099971 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.100058 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.100148 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.100237 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.100327 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.100414 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.100502 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.100585 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.100673 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.100755 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.100845 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.100954 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.101051 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.101196 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.101465 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.101618 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.101712 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.101803 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.101885 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.101972 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.102062 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.102145 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.102225 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.102305 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.102392 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.102474 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.102474 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.102663 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.102792 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.102882 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.102964 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.103052 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.103134 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.103214 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.103294 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.103451 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.103583 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.103678 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.103762 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.103842 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.103922 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.104009 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.104086 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.104167 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.104286 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.104395 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.104478 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.104571 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.104660 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.104787 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.104912 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.105098 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.105213 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.105409 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.105532 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.105753 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.105878 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.106034 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.106155 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.106355 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.106489 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.106665 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.106781 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.106989 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.107103 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.107693 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.107864 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.108004 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.108118 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.108307 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.108420 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.108616 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.108742 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.108927 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.109048 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.109246 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.109370 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.109658 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.109784 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.109893 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.109999 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.110156 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.110270 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.110476 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.110598 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.110783 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.110897 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.111092 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.111210 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.111408 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.111525 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.111719 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.111846 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.112039 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.112119 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.112350 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.112496 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.112665 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.112763 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.112973 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.113091 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.113280 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.113385 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.113643 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.113743 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.113890 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.113978 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.114191 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.114295 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.114496 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.114595 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.114804 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.114974 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.115119 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.115211 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.115449 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.115588 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.115761 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.115875 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.116073 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.116223 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.116380 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.116476 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.116740 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.116956 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.117119 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.117289 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.117500 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.117729 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.117865 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.117983 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.118082 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.118180 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.118281 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.118461 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.118557 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.118772 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.118903 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.119085 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.119175 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.119429 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.119541 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.119745 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.119847 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.120045 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.120134 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.120347 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.120445 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.120657 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.120747 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.120978 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.121077 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.121284 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.121380 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.121597 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.121686 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.121906 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.121996 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.122211 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.122308 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.122516 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.122665 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.122830 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.122928 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.123136 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.123264 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.123660 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.123897 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.124057 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.124211 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.124211 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.124518 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.124518 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.124805 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.124952 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.125199 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.125339 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.125473 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.125604 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.125727 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.125857 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.126000 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.126155 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.126342 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.126469 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.126592 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.126723 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.126864 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.127046 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.127173 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.127296 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.127467 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.127608 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.127756 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.127756 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.127982 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.128107 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.128222 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.128306 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.128470 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.128561 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.128643 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.128855 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.128951 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.129161 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.129256 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.129469 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.129556 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.129793 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.129924 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.130082 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.130174 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.130384 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.130473 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.130692 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.130791 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.130994 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.131084 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.131303 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.131620 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.131725 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.131934 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.132036 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.132783 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.133006 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.133006 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.133205 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.133205 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.133369 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.133450 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.133576 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.133662 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.133750 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.133829 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.133949 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.134082 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.134180 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.134396 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.134493 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.134743 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.134981 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.135084 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.135318 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.135454 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.135656 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.135780 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.135959 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.136065 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.136290 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.136395 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.136567 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.136670 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.136874 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.136979 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.137178 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.137450 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.137552 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.137627 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.137805 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.137972 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.138106 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.138185 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.138409 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.138496 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.138716 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.139026 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.139556 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.139870 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.140180 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.140488 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.140795 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.141107 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.141412 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.141582 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.141729 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.141870 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.142047 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.142204 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.142494 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.142818 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.143120 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.143459 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.143584 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.143765 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.143887 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.144091 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.144211 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.144397 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.144540 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.144701 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.144877 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.145003 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.145225 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.145324 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.145568 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.145665 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.145924 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.146013 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.146240 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.146330 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.146556 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.146664 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.146889 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.146987 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.147200 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.147289 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.147534 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.147899 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.148233 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.148551 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.148710 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.148854 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.148996 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.149171 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.149263 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.149488 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.149581 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.149802 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.149900 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.150114 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.150261 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.150421 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.150513 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.150730 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.150827 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.151036 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.151136 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.151348 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.151473 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.151682 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.151780 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.151989 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.152096 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.152295 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.152391 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.152606 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.152701 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.152917 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.153048 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.153220 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.153322 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.153530 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.153644 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.153834 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.153942 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.154178 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.154284 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.154442 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.154549 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.154750 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.154884 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.155104 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.155187 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.155350 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.155460 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.155674 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.155767 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.155981 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.156069 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.156289 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.156385 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.156607 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.156740 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.156895 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.156993 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.157199 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.157287 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.157509 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.157600 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.157812 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.157908 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.158122 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.158224 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.158431 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.158528 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.158735 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.158823 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.159041 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.159138 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.159356 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.159523 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.159685 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.159781 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.159988 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.160086 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.160294 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.160434 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.160600 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.160697 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.160907 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.161010 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.161210 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.161300 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.161514 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.161605 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.161815 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.161903 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.162117 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.162212 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.162422 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.162536 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.162745 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.162866 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.163066 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.163167 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.163356 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.163586 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.163804 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.163962 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.164117 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.164296 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.164557 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.164672 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.164880 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.165022 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.165186 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.165273 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.165494 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.165593 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.165802 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.165902 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.166114 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.166203 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.166430 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.166531 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.166743 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.166872 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.167055 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.167150 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.167359 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.167477 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.167696 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.167785 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.168011 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.168101 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.168324 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.168422 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.168627 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.168717 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.168932 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.169021 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.169236 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.169332 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.169550 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.169639 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.169857 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.169945 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.170171 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.170258 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.170476 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.170555 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.170779 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.170865 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.171089 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.171174 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.171706 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.171846 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.171970 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.172079 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.172201 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.172312 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.172418 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.172524 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.172631 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.172743 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.172914 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.173029 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.173223 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.173339 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.173538 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.173662 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.173830 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.173945 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.174137 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.174249 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.174441 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.174581 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.174770 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.174883 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.175045 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.175166 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.175913 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.176070 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.176182 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.176297 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.176405 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.176512 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.176626 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.176742 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.176939 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.177050 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.177157 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.177262 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.177378 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.177486 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.177593 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.177709 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.177824 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.177978 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.178107 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.178291 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.178407 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.178619 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.178749 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.178926 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.179058 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.179278 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.179481 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.179750 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.179922 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.180098 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.180235 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.180479 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.180607 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.180783 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.180874 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.181096 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.181293 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.181417 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.181661 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.181770 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.181924 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.182111 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.182236 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.182334 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.182541 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.182713 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.182867 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.183027 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.183179 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.183339 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.183551 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.183688 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.184212 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.184349 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.184349 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.184580 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.184677 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.184763 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.184851 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.184929 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.185155 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.185319 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.185475 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.185630 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.185804 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.186021 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.186113 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.186336 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.186427 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.186658 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.186829 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.187072 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.187170 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.187460 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.187683 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.187683 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.187841 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.188029 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.188165 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.188351 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.188479 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.188720 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.188845 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.188993 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.189087 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.189277 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.189376 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.189587 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.189677 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.189900 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.189987 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.190213 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.190305 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.190521 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.190653 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.190833 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.190970 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.191146 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.191268 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.191476 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.191570 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.191792 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.191881 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.192096 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.192199 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.192416 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.192504 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.192736 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.192833 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.193049 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.193151 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.193370 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.193466 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.193738 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.193852 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.194063 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.194164 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.194371 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.194468 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.194718 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.194825 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.195035 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.195295 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.195483 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.195647 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.195765 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.195956 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.196036 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.196256 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.196353 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.196568 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.196657 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.196874 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.196963 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.197178 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.197269 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.197481 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.197584 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.197792 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.197889 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.198106 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.198205 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.198406 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.198503 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.198708 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.198819 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.199018 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.199128 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.199334 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.199464 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.199660 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.199757 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.199964 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.200052 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.200283 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.200380 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.200588 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.200691 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.200895 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.200985 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.201198 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.201328 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.201500 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.201590 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.201813 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.201903 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.202120 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.202218 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.202424 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.202513 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.202727 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.202817 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.203069 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.203238 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.203428 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.203522 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.203718 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.203862 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.204044 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.204134 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.204361 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.204459 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.204673 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.204772 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.204997 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.205092 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.205302 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.205400 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.205604 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.205706 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.205913 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.206036 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.206217 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.206317 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.206521 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.206621 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.206825 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.206915 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.207130 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.207220 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.207461 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.207567 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.207755 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.207885 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.208052 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.208142 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.208360 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.208450 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.208660 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.208748 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.208961 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.209067 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.209263 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.209356 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.209562 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.209651 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.209866 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.209957 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.210168 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.210282 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.210528 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.210629 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.210865 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.210995 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.211189 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.211314 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.211535 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.211644 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.211857 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.211961 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.212183 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.212263 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.213094 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.213243 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.213359 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.213482 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.213593 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.213707 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.213814 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.213927 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.214034 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.214150 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.214265 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.214385 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.214494 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.214602 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.214709 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.214825 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.214932 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.215103 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.215225 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.215656 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.215840 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.215991 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.216083 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.216154 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.216221 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.216472 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.216716 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.216809 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.217031 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.217112 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.217390 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.217491 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.217658 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.217757 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.217971 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.218242 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.218333 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.218570 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.218669 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.218876 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.218966 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.219184 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.219318 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.219515 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.219649 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.219865 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.219997 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.220150 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.220265 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.220473 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.220596 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.220799 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.220900 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.221138 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.221227 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.221446 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.221530 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.221757 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.221845 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.222070 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.222173 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.222385 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.222480 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.222718 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.222806 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.223034 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.223131 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.223339 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.223499 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.223674 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.223990 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.224303 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.224615 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.224744 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.224924 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.225017 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.225234 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.225341 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.225608 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.225838 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.226213 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.226738 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.226895 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.227015 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.227108 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.227108 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.227270 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.227352 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.227496 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.227595 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.227679 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.227860 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.227957 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.228159 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.228269 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.228471 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.228566 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.228786 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.228889 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.229132 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.229311 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.229451 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.229626 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.229766 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.229964 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.230097 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.230291 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.230423 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.230616 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.230745 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.230944 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.231054 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.231255 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.231351 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.231608 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.231742 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.231915 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.232560 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.232666 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.232871 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.232967 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.233178 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.233324 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.233482 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.233587 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.233800 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.233904 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.234107 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.234253 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.234408 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.234512 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.234727 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.234822 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.235035 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.235138 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.235337 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.235591 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.235743 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.235947 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.236060 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.236256 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.236358 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.236580 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.236676 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.236889 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.237000 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.237192 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.237295 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.237502 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.237595 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.237811 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.237912 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.238121 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.238346 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.238449 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.238698 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.238806 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.239015 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.239118 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.239320 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.239486 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.239646 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.239756 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.239959 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.240080 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.240269 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.240374 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.240572 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.240677 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.240881 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.240980 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.241184 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.241279 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.241518 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.241763 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.242287 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.242371 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.242461 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.242545 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.242635 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.242733 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.242818 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.242900 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.243116 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.243221 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.243442 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.243542 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.243747 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.243843 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.244052 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.244150 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.244362 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.244468 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.244665 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.244761 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.244973 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.245069 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.245274 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.245376 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.245581 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.245683 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.245933 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.246036 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.246180 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.246265 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.246478 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.246562 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.246781 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.246874 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.247828 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.247936 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.248011 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.248080 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.248080 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.248283 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.248395 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.248501 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.248610 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.248717 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.248831 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.249019 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.249130 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.249238 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.249354 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.249469 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.249577 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.249698 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.249814 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.250060 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.250179 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.250375 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.250511 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.250684 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.250811 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.251004 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.251124 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.251316 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.251651 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.252001 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.252318 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.252872 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.253265 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.253587 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.253932 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.254273 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.254580 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.254889 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.255194 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.255521 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.255677 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.255840 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.256069 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.256193 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.256398 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.256538 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.256748 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.256873 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.257058 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.257284 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.257917 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.257917 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.258164 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.258283 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.258400 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.258516 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.258626 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.258827 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.258995 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.259127 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.259278 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.259569 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.259757 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.260119 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.260258 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.260381 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.260500 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.260618 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.260738 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.260856 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.260964 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.261149 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.261422 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.261591 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.261731 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.261854 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.262097 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.262237 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.262356 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.262568 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.262762 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.262886 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.263089 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.263260 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.263416 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.263554 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.263745 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.263892 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.264015 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.264258 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.264443 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.264576 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.264699 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.264896 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.265065 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.265191 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.265318 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.265543 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.265711 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.265843 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.265959 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.266203 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.266425 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.266595 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.266726 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.266847 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.267092 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.267231 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.267358 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.267575 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.267732 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.267855 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.268056 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.268362 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.268531 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.268651 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.268762 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.269009 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.269178 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.269316 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.269431 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.269633 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.269812 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.269934 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.270047 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.270250 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.270418 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.270566 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.270715 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.270838 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.270950 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.271145 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.271267 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.271589 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.271768 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.271886 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.272102 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.272323 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.272439 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.272549 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.272716 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.272912 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.273117 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.273261 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.273381 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.273588 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.273715 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.273916 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.274069 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.277811 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.277971 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.278088 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.278206 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.278331 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.278449 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.278449 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.278665 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.278779 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.278888 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.279010 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.279119 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.279233 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.279356 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.279525 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.279653 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.279773 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.279883 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.280002 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.280111 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.280226 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.280335 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.280451 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.280566 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.280682 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.280682 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.280893 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.281015 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.281124 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.281250 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.281366 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.281480 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.281588 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.281708 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.281708 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.281920 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.282035 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.282152 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.282268 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.282492 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.282608 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.282725 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.282842 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.282957 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.283160 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.283272 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.283405 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.283405 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.283637 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.283747 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 16:20:16.283867 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.283867 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.283867 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.283867 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.283867 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.284423 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.284423 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.284762 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.284992 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.285327 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.285693 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.286018 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.286496 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.286909 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.287238 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.287585 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.287909 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 15 16:20:16.288511 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 15 16:20:16.305790 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_db.sqlalchemy.engines [None req-31cbdf5a-9dca-49cd-80b7-ad8b2a45f238 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116084) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 16:20:16.314130 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_db.sqlalchemy.engines [None req-5af32fd6-834c-4080-a295-b6f99f73cb01 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116085) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 16:20:16.375840 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.context [None req-31cbdf5a-9dca-49cd-80b7-ad8b2a45f238 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12(cell1) {{(pid=116084) load_cells /opt/stack/nova/nova/context.py:464}} Dec 15 16:20:16.380408 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-31cbdf5a-9dca-49cd-80b7-ad8b2a45f238 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:16.382619 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-31cbdf5a-9dca-49cd-80b7-ad8b2a45f238 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:16.383712 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-31cbdf5a-9dca-49cd-80b7-ad8b2a45f238 None None] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:16.386515 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-31cbdf5a-9dca-49cd-80b7-ad8b2a45f238 None None] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:16.395549 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.context [None req-5af32fd6-834c-4080-a295-b6f99f73cb01 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12(cell1) {{(pid=116085) load_cells /opt/stack/nova/nova/context.py:464}} Dec 15 16:20:16.400336 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5af32fd6-834c-4080-a295-b6f99f73cb01 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:16.400997 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_db.sqlalchemy.engines [None req-31cbdf5a-9dca-49cd-80b7-ad8b2a45f238 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116084) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 16:20:16.402283 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5af32fd6-834c-4080-a295-b6f99f73cb01 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:16.403635 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5af32fd6-834c-4080-a295-b6f99f73cb01 None None] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:20:16.404695 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_db.sqlalchemy.engines [None req-31cbdf5a-9dca-49cd-80b7-ad8b2a45f238 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116084) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 16:20:16.405364 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5af32fd6-834c-4080-a295-b6f99f73cb01 None None] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:20:16.420960 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_db.sqlalchemy.engines [None req-5af32fd6-834c-4080-a295-b6f99f73cb01 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116085) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 16:20:16.423038 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_db.sqlalchemy.engines [None req-5af32fd6-834c-4080-a295-b6f99f73cb01 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116085) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 16:20:16.581915 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_db.sqlalchemy.engines [None req-31cbdf5a-9dca-49cd-80b7-ad8b2a45f238 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116084) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 16:20:16.591296 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_db.sqlalchemy.engines [None req-5af32fd6-834c-4080-a295-b6f99f73cb01 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116085) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 15 16:20:16.917531 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: WARNING keystonemiddleware.auth_token [None req-31cbdf5a-9dca-49cd-80b7-ad8b2a45f238 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 16:20:16.924527 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: WARNING keystonemiddleware.auth_token [None req-31cbdf5a-9dca-49cd-80b7-ad8b2a45f238 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 16:20:16.944118 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: WARNING keystonemiddleware.auth_token [None req-5af32fd6-834c-4080-a295-b6f99f73cb01 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 16:20:16.951241 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: WARNING keystonemiddleware.auth_token [None req-5af32fd6-834c-4080-a295-b6f99f73cb01 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 16:20:17.275933 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: WARNING keystonemiddleware.auth_token [None req-31cbdf5a-9dca-49cd-80b7-ad8b2a45f238 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 16:20:17.281196 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: WARNING keystonemiddleware.auth_token [None req-31cbdf5a-9dca-49cd-80b7-ad8b2a45f238 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 16:20:17.286615 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ca9dc7c9c0 pid: 116084 (default app) Dec 15 16:20:17.304881 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: WARNING keystonemiddleware.auth_token [None req-5af32fd6-834c-4080-a295-b6f99f73cb01 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 15 16:20:17.310255 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: WARNING keystonemiddleware.auth_token [None req-5af32fd6-834c-4080-a295-b6f99f73cb01 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 15 16:20:17.317147 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ca9dc7c9c0 pid: 116085 (default app) Dec 15 16:20:58.595244 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-95b96c76-7301-4f13-8945-c38a4e19030b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1410284276", "imageRef": "b72b5f54-34d0-48ac-9484-bc8104a6dddb", "flavorRef": "452", "networks": [{"uuid": "d3a23e9e-8c1c-4ad2-af72-ef7451820760"}]}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:20:58.641933 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c33231b9-fea8-45b8-98e0-c40ba24b2187 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-833232317", "imageRef": "b72b5f54-34d0-48ac-9484-bc8104a6dddb", "flavorRef": "452", "networks": [{"uuid": "4c226192-4f17-4f1d-a98b-2b01a790e168"}]}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:20:59.339316 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.network.neutron [None req-95b96c76-7301-4f13-8945-c38a4e19030b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] validate_networks() for [('d3a23e9e-8c1c-4ad2-af72-ef7451820760', None, None, None, None, None)] {{(pid=116085) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:20:59.418620 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.network.neutron [None req-c33231b9-fea8-45b8-98e0-c40ba24b2187 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] validate_networks() for [('4c226192-4f17-4f1d-a98b-2b01a790e168', None, None, None, None, None)] {{(pid=116084) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:21:02.043685 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-c33231b9-fea8-45b8-98e0-c40ba24b2187 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Flavor limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:21:02.045963 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-c33231b9-fea8-45b8-98e0-c40ba24b2187 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Image limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:21:02.047424 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-c33231b9-fea8-45b8-98e0-c40ba24b2187 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Flavor pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:21:02.048497 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-c33231b9-fea8-45b8-98e0-c40ba24b2187 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Image pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:21:02.051090 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-c33231b9-fea8-45b8-98e0-c40ba24b2187 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:21:02.084044 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c33231b9-fea8-45b8-98e0-c40ba24b2187 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:02.085310 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c33231b9-fea8-45b8-98e0-c40ba24b2187 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:02.088197 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c33231b9-fea8-45b8-98e0-c40ba24b2187 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:02.089293 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c33231b9-fea8-45b8-98e0-c40ba24b2187 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:02.124752 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-95b96c76-7301-4f13-8945-c38a4e19030b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Flavor limits 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:21:02.126102 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-95b96c76-7301-4f13-8945-c38a4e19030b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Image limits 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:21:02.126677 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-95b96c76-7301-4f13-8945-c38a4e19030b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Flavor pref 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:21:02.127286 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-95b96c76-7301-4f13-8945-c38a4e19030b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Image pref 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:21:02.127950 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-95b96c76-7301-4f13-8945-c38a4e19030b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:21:02.172508 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-95b96c76-7301-4f13-8945-c38a4e19030b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:02.172911 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-95b96c76-7301-4f13-8945-c38a4e19030b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:02.176009 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-95b96c76-7301-4f13-8945-c38a4e19030b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:02.176578 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-95b96c76-7301-4f13-8945-c38a4e19030b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:02.192653 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-c33231b9-fea8-45b8-98e0-c40ba24b2187 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Getting quotas for project afaba77899e64379bebe94bb60ec1876. Resources: {'cores', 'instances', 'ram'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:21:02.224285 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-c33231b9-fea8-45b8-98e0-c40ba24b2187 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Getting quotas for user ff15ede3a4f04e48bea87424ba6424ff and project afaba77899e64379bebe94bb60ec1876. Resources: {'cores', 'instances', 'ram'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:21:02.225972 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-95b96c76-7301-4f13-8945-c38a4e19030b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Getting quotas for project 6cccb6b08dc94f04a5efa2624d350007. Resources: {'cores', 'instances', 'ram'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:21:02.235393 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-95b96c76-7301-4f13-8945-c38a4e19030b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Getting quotas for user 27c81feca86e49f193efb42a81a6c3c1 and project 6cccb6b08dc94f04a5efa2624d350007. Resources: {'cores', 'instances', 'ram'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:21:02.259204 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-95b96c76-7301-4f13-8945-c38a4e19030b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Going to run 1 instances... {{(pid=116085) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:21:02.270267 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-95b96c76-7301-4f13-8945-c38a4e19030b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: 365b5223-e068-4113-abe1-797e13f5e901] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b72b5f54-34d0-48ac-9484-bc8104a6dddb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116085) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:21:02.270509 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c33231b9-fea8-45b8-98e0-c40ba24b2187 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Going to run 1 instances... {{(pid=116084) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:21:02.276370 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c33231b9-fea8-45b8-98e0-c40ba24b2187 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] [instance: 619e9cc8-266e-47ae-a393-2140979be159] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b72b5f54-34d0-48ac-9484-bc8104a6dddb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116084) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:21:02.534780 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-95b96c76-7301-4f13-8945-c38a4e19030b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.569400 Dec 15 16:21:02.535442 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 1/1] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Dec 15 16:20:56 2021] POST /compute/v2.1/servers => generated 380 bytes in 5573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 16:21:02.548986 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-41862e36-de54-41e8-8863-da67f577c77d tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:02.549599 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-41862e36-de54-41e8-8863-da67f577c77d tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: 365b5223-e068-4113-abe1-797e13f5e901] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:02.596355 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c33231b9-fea8-45b8-98e0-c40ba24b2187 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.716856 Dec 15 16:21:02.610146 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 1/2] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Dec 15 16:20:56 2021] POST /compute/v2.1/servers => generated 380 bytes in 5735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 15 16:21:02.623962 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-4f7eb295-2114-41eb-ae1e-62f3cf574632 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:02.628281 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-4f7eb295-2114-41eb-ae1e-62f3cf574632 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] [instance: 619e9cc8-266e-47ae-a393-2140979be159] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:02.869205 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-41862e36-de54-41e8-8863-da67f577c77d tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:02.953806 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-41862e36-de54-41e8-8863-da67f577c77d tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901" status: 200 len: 1218 microversion: 2.1 time: 0.408347 Dec 15 16:21:02.956829 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 2/3] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:02 2021] GET /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901 => generated 1218 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:21:03.001670 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-4f7eb295-2114-41eb-ae1e-62f3cf574632 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff15ede3a4f04e48bea87424ba6424ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaba77899e64379bebe94bb60ec1876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:03.032091 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-4f7eb295-2114-41eb-ae1e-62f3cf574632 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] 10.222.0.60 "GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159" status: 200 len: 1214 microversion: 2.1 time: 0.419209 Dec 15 16:21:03.041500 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 2/4] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:02 2021] GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159 => generated 1214 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:03.978228 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-6b389ab1-d143-40e5-b8cc-3d9606621b9b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:03.979407 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-6b389ab1-d143-40e5-b8cc-3d9606621b9b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: 365b5223-e068-4113-abe1-797e13f5e901] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:04.065319 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-04c7156f-e7a8-42b5-8493-c0fe24d2b1c4 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:04.066385 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-04c7156f-e7a8-42b5-8493-c0fe24d2b1c4 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] [instance: 619e9cc8-266e-47ae-a393-2140979be159] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:04.648118 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-6b389ab1-d143-40e5-b8cc-3d9606621b9b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:04.698061 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-6b389ab1-d143-40e5-b8cc-3d9606621b9b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901" status: 200 len: 1218 microversion: 2.1 time: 0.723113 Dec 15 16:21:04.700604 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 3/5] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:03 2021] GET /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901 => generated 1218 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:04.741205 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-04c7156f-e7a8-42b5-8493-c0fe24d2b1c4 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff15ede3a4f04e48bea87424ba6424ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaba77899e64379bebe94bb60ec1876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:04.782754 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-04c7156f-e7a8-42b5-8493-c0fe24d2b1c4 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] 10.222.0.60 "GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159" status: 200 len: 1214 microversion: 2.1 time: 0.713041 Dec 15 16:21:04.787358 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 3/6] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:04 2021] GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159 => generated 1214 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:05.724195 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-688283fa-5caf-4a5c-b686-d28a13d87152 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:05.725008 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-688283fa-5caf-4a5c-b686-d28a13d87152 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: 365b5223-e068-4113-abe1-797e13f5e901] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:05.789095 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-688283fa-5caf-4a5c-b686-d28a13d87152 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:05.791455 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-688283fa-5caf-4a5c-b686-d28a13d87152 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:05.803283 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-688283fa-5caf-4a5c-b686-d28a13d87152 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:05.809062 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d5d51cbb-268e-4d25-8647-5b037123bedd tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:05.815310 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d5d51cbb-268e-4d25-8647-5b037123bedd tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] [instance: 619e9cc8-266e-47ae-a393-2140979be159] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:05.817294 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-688283fa-5caf-4a5c-b686-d28a13d87152 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:05.856661 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d5d51cbb-268e-4d25-8647-5b037123bedd tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:05.864431 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d5d51cbb-268e-4d25-8647-5b037123bedd tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:05.879114 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d5d51cbb-268e-4d25-8647-5b037123bedd tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:05.885918 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d5d51cbb-268e-4d25-8647-5b037123bedd tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:07.291952 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-688283fa-5caf-4a5c-b686-d28a13d87152 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:07.318949 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-688283fa-5caf-4a5c-b686-d28a13d87152 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901" status: 200 len: 1214 microversion: 2.1 time: 1.604090 Dec 15 16:21:07.319477 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 4/7] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:05 2021] GET /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901 => generated 1214 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:07.328636 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d5d51cbb-268e-4d25-8647-5b037123bedd tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff15ede3a4f04e48bea87424ba6424ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaba77899e64379bebe94bb60ec1876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:07.381370 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d5d51cbb-268e-4d25-8647-5b037123bedd tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] 10.222.0.60 "GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159" status: 200 len: 1266 microversion: 2.1 time: 1.580614 Dec 15 16:21:07.383059 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 4/8] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:05 2021] GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159 => generated 1266 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:08.352564 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-77e3d103-0bd7-4baa-a50e-5b6c4a42078e tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:08.354143 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-77e3d103-0bd7-4baa-a50e-5b6c4a42078e tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: 365b5223-e068-4113-abe1-797e13f5e901] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:08.368588 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-77e3d103-0bd7-4baa-a50e-5b6c4a42078e tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:08.369316 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-77e3d103-0bd7-4baa-a50e-5b6c4a42078e tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:08.370305 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-77e3d103-0bd7-4baa-a50e-5b6c4a42078e tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:08.376923 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-77e3d103-0bd7-4baa-a50e-5b6c4a42078e tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:08.407184 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-6c6bd257-ed1f-48c4-b5f8-966c7b34052a tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:08.413703 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-6c6bd257-ed1f-48c4-b5f8-966c7b34052a tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] [instance: 619e9cc8-266e-47ae-a393-2140979be159] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:08.448303 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6c6bd257-ed1f-48c4-b5f8-966c7b34052a tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:08.449849 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6c6bd257-ed1f-48c4-b5f8-966c7b34052a tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:08.452054 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6c6bd257-ed1f-48c4-b5f8-966c7b34052a tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:08.453233 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6c6bd257-ed1f-48c4-b5f8-966c7b34052a tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:08.776741 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-6c6bd257-ed1f-48c4-b5f8-966c7b34052a tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff15ede3a4f04e48bea87424ba6424ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaba77899e64379bebe94bb60ec1876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:08.811807 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-6c6bd257-ed1f-48c4-b5f8-966c7b34052a tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] 10.222.0.60 "GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159" status: 200 len: 1272 microversion: 2.1 time: 0.412227 Dec 15 16:21:08.824030 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 5/9] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:08 2021] GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159 => generated 1272 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:21:08.836154 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-77e3d103-0bd7-4baa-a50e-5b6c4a42078e tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:08.848985 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-77e3d103-0bd7-4baa-a50e-5b6c4a42078e tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901" status: 200 len: 1276 microversion: 2.1 time: 0.511030 Dec 15 16:21:08.853350 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 5/10] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:08 2021] GET /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901 => generated 1276 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:09.858951 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-8e4c5f3d-8b25-4a3e-981d-6d830c3ee946 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:09.862835 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-8e4c5f3d-8b25-4a3e-981d-6d830c3ee946 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] [instance: 619e9cc8-266e-47ae-a393-2140979be159] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:09.888974 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-082d5c2d-ea55-4425-8ba1-ab4c459b14b3 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:09.888974 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-082d5c2d-ea55-4425-8ba1-ab4c459b14b3 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: 365b5223-e068-4113-abe1-797e13f5e901] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:09.898568 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-082d5c2d-ea55-4425-8ba1-ab4c459b14b3 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:09.904706 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-082d5c2d-ea55-4425-8ba1-ab4c459b14b3 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:09.906684 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-082d5c2d-ea55-4425-8ba1-ab4c459b14b3 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:09.914004 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-082d5c2d-ea55-4425-8ba1-ab4c459b14b3 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:09.917744 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8e4c5f3d-8b25-4a3e-981d-6d830c3ee946 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:09.920860 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8e4c5f3d-8b25-4a3e-981d-6d830c3ee946 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:09.928395 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8e4c5f3d-8b25-4a3e-981d-6d830c3ee946 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:09.929708 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8e4c5f3d-8b25-4a3e-981d-6d830c3ee946 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:10.749366 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-082d5c2d-ea55-4425-8ba1-ab4c459b14b3 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:10.759899 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-082d5c2d-ea55-4425-8ba1-ab4c459b14b3 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901" status: 200 len: 1276 microversion: 2.1 time: 0.881363 Dec 15 16:21:10.768560 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 6/11] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:09 2021] GET /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901 => generated 1276 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:21:10.849673 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-8e4c5f3d-8b25-4a3e-981d-6d830c3ee946 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff15ede3a4f04e48bea87424ba6424ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaba77899e64379bebe94bb60ec1876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:10.933242 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-8e4c5f3d-8b25-4a3e-981d-6d830c3ee946 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] 10.222.0.60 "GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159" status: 200 len: 1272 microversion: 2.1 time: 1.104932 Dec 15 16:21:10.957208 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 6/12] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:09 2021] GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159 => generated 1272 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:11.793814 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-7f93913f-61b5-4da4-a35c-66d381167602 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:11.795213 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-7f93913f-61b5-4da4-a35c-66d381167602 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: 365b5223-e068-4113-abe1-797e13f5e901] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:11.831855 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7f93913f-61b5-4da4-a35c-66d381167602 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:11.835363 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7f93913f-61b5-4da4-a35c-66d381167602 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:11.837439 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7f93913f-61b5-4da4-a35c-66d381167602 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:11.842236 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7f93913f-61b5-4da4-a35c-66d381167602 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:11.989545 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1fa010ae-c77a-4243-8fbe-d14acf72921e tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:11.991081 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1fa010ae-c77a-4243-8fbe-d14acf72921e tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] [instance: 619e9cc8-266e-47ae-a393-2140979be159] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:12.008900 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1fa010ae-c77a-4243-8fbe-d14acf72921e tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:12.011912 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1fa010ae-c77a-4243-8fbe-d14acf72921e tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:12.017720 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1fa010ae-c77a-4243-8fbe-d14acf72921e tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:12.022584 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1fa010ae-c77a-4243-8fbe-d14acf72921e tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:12.147189 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-7f93913f-61b5-4da4-a35c-66d381167602 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:12.159107 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-7f93913f-61b5-4da4-a35c-66d381167602 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901" status: 200 len: 1276 microversion: 2.1 time: 0.369787 Dec 15 16:21:12.163161 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 7/13] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:11 2021] GET /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901 => generated 1276 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:21:12.991563 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1fa010ae-c77a-4243-8fbe-d14acf72921e tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff15ede3a4f04e48bea87424ba6424ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaba77899e64379bebe94bb60ec1876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:13.041778 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1fa010ae-c77a-4243-8fbe-d14acf72921e tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] 10.222.0.60 "GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159" status: 200 len: 1314 microversion: 2.1 time: 1.042035 Dec 15 16:21:13.041778 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 7/14] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:11 2021] GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159 => generated 1314 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:21:13.203839 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-ed573691-0500-4630-87cd-b9acc18f2e4b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:13.206317 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-ed573691-0500-4630-87cd-b9acc18f2e4b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: 365b5223-e068-4113-abe1-797e13f5e901] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:13.219287 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ed573691-0500-4630-87cd-b9acc18f2e4b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:13.221227 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ed573691-0500-4630-87cd-b9acc18f2e4b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:13.223653 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ed573691-0500-4630-87cd-b9acc18f2e4b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:13.225653 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ed573691-0500-4630-87cd-b9acc18f2e4b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:14.059111 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-196f41ec-93be-473f-947b-b45c4dc06eb2 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:14.059897 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-196f41ec-93be-473f-947b-b45c4dc06eb2 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] [instance: 619e9cc8-266e-47ae-a393-2140979be159] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:14.103483 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-196f41ec-93be-473f-947b-b45c4dc06eb2 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:14.105017 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-196f41ec-93be-473f-947b-b45c4dc06eb2 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:14.109039 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-196f41ec-93be-473f-947b-b45c4dc06eb2 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:14.110800 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-196f41ec-93be-473f-947b-b45c4dc06eb2 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:14.744126 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-ed573691-0500-4630-87cd-b9acc18f2e4b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:14.762244 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-ed573691-0500-4630-87cd-b9acc18f2e4b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901" status: 200 len: 1318 microversion: 2.1 time: 1.556325 Dec 15 16:21:14.772082 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 8/15] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:13 2021] GET /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901 => generated 1318 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:15.360891 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-89fe2bfa-8161-4079-b83b-671089eafb88 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'create', calling method: .version_select at 0x7f0b291d4790>, body: {"keypair": {"name": "tempest-keypair-123014102"}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:21:15.490014 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-89fe2bfa-8161-4079-b83b-671089eafb88 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Getting quotas for project 28737128a7574d248ba7e4e536171af2. Resources: {'key_pairs'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:21:15.515475 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-89fe2bfa-8161-4079-b83b-671089eafb88 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Getting quotas for user 99b3403e60df4fbd9a5fdffe01a5efb7 and project 28737128a7574d248ba7e4e536171af2. Resources: {'key_pairs'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:21:15.702366 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-196f41ec-93be-473f-947b-b45c4dc06eb2 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff15ede3a4f04e48bea87424ba6424ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaba77899e64379bebe94bb60ec1876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:15.796138 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-196f41ec-93be-473f-947b-b45c4dc06eb2 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] 10.222.0.60 "GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159" status: 200 len: 1314 microversion: 2.1 time: 1.739925 Dec 15 16:21:15.826991 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 8/16] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:14 2021] GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159 => generated 1314 bytes in 1780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:15.879444 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-8dc74473-dfd4-4cb7-928e-7ea65550b9cd tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:15.880556 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-8dc74473-dfd4-4cb7-928e-7ea65550b9cd tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: 365b5223-e068-4113-abe1-797e13f5e901] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:15.943053 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8dc74473-dfd4-4cb7-928e-7ea65550b9cd tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:15.948452 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8dc74473-dfd4-4cb7-928e-7ea65550b9cd tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:15.959649 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8dc74473-dfd4-4cb7-928e-7ea65550b9cd tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:15.966692 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8dc74473-dfd4-4cb7-928e-7ea65550b9cd tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:16.160410 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-89fe2bfa-8161-4079-b83b-671089eafb88 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Getting quotas for project 28737128a7574d248ba7e4e536171af2. Resources: {'key_pairs'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:21:16.171567 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-89fe2bfa-8161-4079-b83b-671089eafb88 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Getting quotas for user 99b3403e60df4fbd9a5fdffe01a5efb7 and project 28737128a7574d248ba7e4e536171af2. Resources: {'key_pairs'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:21:16.273177 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-89fe2bfa-8161-4079-b83b-671089eafb88 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 1.497242 Dec 15 16:21:16.277972 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 9/17] 10.222.0.60 () {60 vars in 1157 bytes} [Wed Dec 15 16:21:14 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:16.870536 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-22ef2348-03df-4648-a239-7864bdc4e9bd tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:16.907039 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-22ef2348-03df-4648-a239-7864bdc4e9bd tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] [instance: 619e9cc8-266e-47ae-a393-2140979be159] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:16.955023 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-22ef2348-03df-4648-a239-7864bdc4e9bd tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:16.972985 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-22ef2348-03df-4648-a239-7864bdc4e9bd tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:17.039106 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-22ef2348-03df-4648-a239-7864bdc4e9bd tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:17.039678 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-22ef2348-03df-4648-a239-7864bdc4e9bd tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:17.795583 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-8dc74473-dfd4-4cb7-928e-7ea65550b9cd tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:17.804836 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-8dc74473-dfd4-4cb7-928e-7ea65550b9cd tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901" status: 200 len: 1318 microversion: 2.1 time: 1.975002 Dec 15 16:21:17.805451 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 9/18] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:15 2021] GET /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901 => generated 1318 bytes in 1978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:18.050891 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-22ef2348-03df-4648-a239-7864bdc4e9bd tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff15ede3a4f04e48bea87424ba6424ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaba77899e64379bebe94bb60ec1876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:18.059420 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-22ef2348-03df-4648-a239-7864bdc4e9bd tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] 10.222.0.60 "GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159" status: 200 len: 1314 microversion: 2.1 time: 1.229673 Dec 15 16:21:18.069825 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 10/19] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:16 2021] GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159 => generated 1314 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:21:18.844797 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-4314b1a2-8471-4550-89ac-403a6e2c0b8a tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:18.846338 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-4314b1a2-8471-4550-89ac-403a6e2c0b8a tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: 365b5223-e068-4113-abe1-797e13f5e901] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:18.861238 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4314b1a2-8471-4550-89ac-403a6e2c0b8a tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:18.871343 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4314b1a2-8471-4550-89ac-403a6e2c0b8a tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:18.872555 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4314b1a2-8471-4550-89ac-403a6e2c0b8a tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:18.874592 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4314b1a2-8471-4550-89ac-403a6e2c0b8a tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:19.495318 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-4314b1a2-8471-4550-89ac-403a6e2c0b8a tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:19.520785 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-4314b1a2-8471-4550-89ac-403a6e2c0b8a tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901" status: 200 len: 1318 microversion: 2.1 time: 0.681767 Dec 15 16:21:19.545687 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 10/20] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:18 2021] GET /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901 => generated 1318 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:19.559981 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-66965c03-c37f-4ec6-90f5-b9af2d8ba608 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:19.575280 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-66965c03-c37f-4ec6-90f5-b9af2d8ba608 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] [instance: 619e9cc8-266e-47ae-a393-2140979be159] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:19.619212 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-66965c03-c37f-4ec6-90f5-b9af2d8ba608 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:19.627072 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-66965c03-c37f-4ec6-90f5-b9af2d8ba608 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:19.629602 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-66965c03-c37f-4ec6-90f5-b9af2d8ba608 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:19.633007 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-66965c03-c37f-4ec6-90f5-b9af2d8ba608 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:20.435499 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-66965c03-c37f-4ec6-90f5-b9af2d8ba608 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff15ede3a4f04e48bea87424ba6424ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaba77899e64379bebe94bb60ec1876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:20.453611 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-66965c03-c37f-4ec6-90f5-b9af2d8ba608 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] 10.222.0.60 "GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159" status: 200 len: 1314 microversion: 2.1 time: 0.905539 Dec 15 16:21:20.458272 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 11/21] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:19 2021] GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159 => generated 1314 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:20.551276 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f0db66b2-8aa8-46ab-b101-93737f9a4564 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:20.553372 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f0db66b2-8aa8-46ab-b101-93737f9a4564 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: 365b5223-e068-4113-abe1-797e13f5e901] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:20.590438 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f0db66b2-8aa8-46ab-b101-93737f9a4564 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:20.591522 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f0db66b2-8aa8-46ab-b101-93737f9a4564 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:20.600767 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f0db66b2-8aa8-46ab-b101-93737f9a4564 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:20.603844 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f0db66b2-8aa8-46ab-b101-93737f9a4564 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:20.992261 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-2ad8fb46-70bb-4b59-96b0-4e161da24243 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-243955657", "imageRef": "b72b5f54-34d0-48ac-9484-bc8104a6dddb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6f85be06-be2a-46cd-ac10-179b1abdc90e"}]}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:21:21.226308 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.network.neutron [None req-2ad8fb46-70bb-4b59-96b0-4e161da24243 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] validate_networks() for [('6f85be06-be2a-46cd-ac10-179b1abdc90e', None, None, None, None, None)] {{(pid=116085) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:21:23.495679 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f0db66b2-8aa8-46ab-b101-93737f9a4564 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:23.517443 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f0db66b2-8aa8-46ab-b101-93737f9a4564 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901" status: 200 len: 1318 microversion: 2.1 time: 2.970165 Dec 15 16:21:23.535322 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 12/22] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:20 2021] GET /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901 => generated 1318 bytes in 2989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:21:23.552662 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-54ae0989-0079-470e-8239-b4cb971734de tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:23.556808 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-54ae0989-0079-470e-8239-b4cb971734de tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] [instance: 619e9cc8-266e-47ae-a393-2140979be159] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:23.581955 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-54ae0989-0079-470e-8239-b4cb971734de tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:23.588860 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-54ae0989-0079-470e-8239-b4cb971734de tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:23.589951 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-54ae0989-0079-470e-8239-b4cb971734de tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:23.590400 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-54ae0989-0079-470e-8239-b4cb971734de tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:25.209413 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-54ae0989-0079-470e-8239-b4cb971734de tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff15ede3a4f04e48bea87424ba6424ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaba77899e64379bebe94bb60ec1876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:25.233705 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-54ae0989-0079-470e-8239-b4cb971734de tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] 10.222.0.60 "GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159" status: 200 len: 1314 microversion: 2.1 time: 1.695696 Dec 15 16:21:25.240030 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 13/23] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:23 2021] GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159 => generated 1314 bytes in 1704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:26.010555 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-2ad8fb46-70bb-4b59-96b0-4e161da24243 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Flavor limits 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:21:26.011829 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-2ad8fb46-70bb-4b59-96b0-4e161da24243 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Image limits 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:21:26.014034 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-2ad8fb46-70bb-4b59-96b0-4e161da24243 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Flavor pref 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:21:26.017700 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-2ad8fb46-70bb-4b59-96b0-4e161da24243 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Image pref 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:21:26.020630 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-2ad8fb46-70bb-4b59-96b0-4e161da24243 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:21:26.068253 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2ad8fb46-70bb-4b59-96b0-4e161da24243 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:26.069056 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2ad8fb46-70bb-4b59-96b0-4e161da24243 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:26.070806 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2ad8fb46-70bb-4b59-96b0-4e161da24243 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:26.075165 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2ad8fb46-70bb-4b59-96b0-4e161da24243 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:26.145757 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-ff70b40d-fffa-4586-a58b-725900639f5c req-a60cc753-8217-42db-9c95-7e510b9d59c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "619e9cc8-266e-47ae-a393-2140979be159", "tag": "bdc0e4f8-fd70-4efb-be09-06ef2ca1e701"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:21:26.156403 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:21:26.156403 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:21:26.197730 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-2ad8fb46-70bb-4b59-96b0-4e161da24243 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Getting quotas for project a4cdbc8211774d9fb8b9dbf7e3f1f080. Resources: {'cores', 'instances', 'ram'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:21:26.214219 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-2ad8fb46-70bb-4b59-96b0-4e161da24243 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Getting quotas for user f998e8e291e942f3a088abe00f0b7c79 and project a4cdbc8211774d9fb8b9dbf7e3f1f080. Resources: {'cores', 'instances', 'ram'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:21:26.218025 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-ff70b40d-fffa-4586-a58b-725900639f5c req-a60cc753-8217-42db-9c95-7e510b9d59c2 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:26.223026 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-ff70b40d-fffa-4586-a58b-725900639f5c req-a60cc753-8217-42db-9c95-7e510b9d59c2 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:26.282139 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-2ad8fb46-70bb-4b59-96b0-4e161da24243 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Going to run 1 instances... {{(pid=116085) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:21:26.296690 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-2ad8fb46-70bb-4b59-96b0-4e161da24243 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b72b5f54-34d0-48ac-9484-bc8104a6dddb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116085) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:21:26.343189 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-ff70b40d-fffa-4586-a58b-725900639f5c req-a60cc753-8217-42db-9c95-7e510b9d59c2 service nova] Creating event network-changed:bdc0e4f8-fd70-4efb-be09-06ef2ca1e701 for instance 619e9cc8-266e-47ae-a393-2140979be159 on hv-cinder-81268 Dec 15 16:21:26.352265 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-ff70b40d-fffa-4586-a58b-725900639f5c req-a60cc753-8217-42db-9c95-7e510b9d59c2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116084) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 15 16:21:26.360071 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5143d4db-31bd-4c89-ad4e-696d819d26e4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:26.365440 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5143d4db-31bd-4c89-ad4e-696d819d26e4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:26.367130 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5143d4db-31bd-4c89-ad4e-696d819d26e4 None None] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:26.376940 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5143d4db-31bd-4c89-ad4e-696d819d26e4 None None] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:26.422673 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.compute.rpcapi [None req-5143d4db-31bd-4c89-ad4e-696d819d26e4 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 15 16:21:26.425733 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5143d4db-31bd-4c89-ad4e-696d819d26e4 None None] Releasing lock "compute-rpcapi-router" {{(pid=116084) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 15 16:21:26.515800 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-2ad8fb46-70bb-4b59-96b0-4e161da24243 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 7.591534 Dec 15 16:21:26.522857 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 11/24] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Dec 15 16:21:18 2021] POST /compute/v2.1/servers => generated 383 bytes in 7601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 16:21:26.538791 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-5143d4db-31bd-4c89-ad4e-696d819d26e4 None None] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.296450 Dec 15 16:21:26.542491 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-09c3ede3-2d8f-4815-9e2c-d44fe4119e10 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:26.543907 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-09c3ede3-2d8f-4815-9e2c-d44fe4119e10 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: 365b5223-e068-4113-abe1-797e13f5e901] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:26.546540 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 14/25] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:21:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:21:26.580561 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-fd30d94f-0ae9-44db-9c7c-dc6e08644c53 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:26.583144 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-09c3ede3-2d8f-4815-9e2c-d44fe4119e10 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:26.583675 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-09c3ede3-2d8f-4815-9e2c-d44fe4119e10 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:26.584486 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-09c3ede3-2d8f-4815-9e2c-d44fe4119e10 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:26.584924 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-09c3ede3-2d8f-4815-9e2c-d44fe4119e10 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:26.588118 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-fd30d94f-0ae9-44db-9c7c-dc6e08644c53 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] [instance: 619e9cc8-266e-47ae-a393-2140979be159] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:26.663331 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fd30d94f-0ae9-44db-9c7c-dc6e08644c53 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:26.683945 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fd30d94f-0ae9-44db-9c7c-dc6e08644c53 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:26.697067 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fd30d94f-0ae9-44db-9c7c-dc6e08644c53 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:26.698773 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fd30d94f-0ae9-44db-9c7c-dc6e08644c53 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:27.847933 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-09c3ede3-2d8f-4815-9e2c-d44fe4119e10 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:27.879149 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-09c3ede3-2d8f-4815-9e2c-d44fe4119e10 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901" status: 200 len: 1318 microversion: 2.1 time: 1.352592 Dec 15 16:21:27.881466 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 12/26] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:26 2021] GET /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901 => generated 1318 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:27.901416 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-16bb7f46-d668-4657-a725-2245fa763d5e tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:27.902529 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-16bb7f46-d668-4657-a725-2245fa763d5e tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:27.991321 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-fd30d94f-0ae9-44db-9c7c-dc6e08644c53 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff15ede3a4f04e48bea87424ba6424ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaba77899e64379bebe94bb60ec1876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:28.011234 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-fd30d94f-0ae9-44db-9c7c-dc6e08644c53 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] 10.222.0.60 "GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159" status: 200 len: 1314 microversion: 2.1 time: 1.457742 Dec 15 16:21:28.014220 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 15/27] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:26 2021] GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159 => generated 1314 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:28.100275 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-16bb7f46-d668-4657-a725-2245fa763d5e tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:28.122647 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-16bb7f46-d668-4657-a725-2245fa763d5e tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1221 microversion: 2.1 time: 0.232990 Dec 15 16:21:28.125727 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 13/28] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:27 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1221 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:28.644378 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-767effbd-8356-4da4-83ce-0cbd7e876974 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1594115683", "imageRef": "b72b5f54-34d0-48ac-9484-bc8104a6dddb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6f85be06-be2a-46cd-ac10-179b1abdc90e"}]}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:21:28.807037 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.network.neutron [None req-767effbd-8356-4da4-83ce-0cbd7e876974 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] validate_networks() for [('6f85be06-be2a-46cd-ac10-179b1abdc90e', None, None, None, None, None)] {{(pid=116084) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:21:28.899275 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-ce546b26-d15c-49ed-b8d2-9e438a39eed7 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:28.900166 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-ce546b26-d15c-49ed-b8d2-9e438a39eed7 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: 365b5223-e068-4113-abe1-797e13f5e901] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:28.911413 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ce546b26-d15c-49ed-b8d2-9e438a39eed7 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:28.916010 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ce546b26-d15c-49ed-b8d2-9e438a39eed7 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:28.920793 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ce546b26-d15c-49ed-b8d2-9e438a39eed7 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:28.921384 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ce546b26-d15c-49ed-b8d2-9e438a39eed7 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:29.726438 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-ce546b26-d15c-49ed-b8d2-9e438a39eed7 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:29.747869 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-ce546b26-d15c-49ed-b8d2-9e438a39eed7 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901" status: 200 len: 1318 microversion: 2.1 time: 0.851976 Dec 15 16:21:29.750609 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 14/29] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:28 2021] GET /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901 => generated 1318 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:29.771029 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-11f5fbe6-93d4-40cf-ad40-acb1c4e1de74 req-da701244-e777-44d5-9dd0-f516691e1eb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "365b5223-e068-4113-abe1-797e13f5e901", "tag": "2a99c3c6-1c76-4557-ba21-b6d579694eac"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:21:29.786485 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:21:29.786485 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Dec 15 16:21:29.820351 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-11f5fbe6-93d4-40cf-ad40-acb1c4e1de74 req-da701244-e777-44d5-9dd0-f516691e1eb8 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:29.825673 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-11f5fbe6-93d4-40cf-ad40-acb1c4e1de74 req-da701244-e777-44d5-9dd0-f516691e1eb8 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:29.905429 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-11f5fbe6-93d4-40cf-ad40-acb1c4e1de74 req-da701244-e777-44d5-9dd0-f516691e1eb8 service nova] Creating event network-changed:2a99c3c6-1c76-4557-ba21-b6d579694eac for instance 365b5223-e068-4113-abe1-797e13f5e901 on hv-cinder-81268 Dec 15 16:21:29.907774 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-11f5fbe6-93d4-40cf-ad40-acb1c4e1de74 req-da701244-e777-44d5-9dd0-f516691e1eb8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116085) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 15 16:21:29.913766 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-cb53874f-5a91-4258-a89d-a0f4d3f7d915 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:29.914854 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-cb53874f-5a91-4258-a89d-a0f4d3f7d915 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:29.916899 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-cb53874f-5a91-4258-a89d-a0f4d3f7d915 None None] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:29.917989 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-cb53874f-5a91-4258-a89d-a0f4d3f7d915 None None] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:29.942212 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.compute.rpcapi [None req-cb53874f-5a91-4258-a89d-a0f4d3f7d915 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 15 16:21:29.946407 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-cb53874f-5a91-4258-a89d-a0f4d3f7d915 None None] Releasing lock "compute-rpcapi-router" {{(pid=116085) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 15 16:21:30.037981 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-cb53874f-5a91-4258-a89d-a0f4d3f7d915 None None] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.281249 Dec 15 16:21:30.039762 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 15/30] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:21:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:21:30.066439 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-46f17e21-805e-448f-aabd-0920678689a8 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:30.092452 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-46f17e21-805e-448f-aabd-0920678689a8 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] [instance: 619e9cc8-266e-47ae-a393-2140979be159] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:30.146784 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-46f17e21-805e-448f-aabd-0920678689a8 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:30.147973 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-46f17e21-805e-448f-aabd-0920678689a8 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:30.151851 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-46f17e21-805e-448f-aabd-0920678689a8 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:30.153216 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-46f17e21-805e-448f-aabd-0920678689a8 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:30.799770 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-767effbd-8356-4da4-83ce-0cbd7e876974 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Flavor limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:21:30.800642 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-767effbd-8356-4da4-83ce-0cbd7e876974 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Image limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:21:30.801007 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-767effbd-8356-4da4-83ce-0cbd7e876974 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Flavor pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:21:30.801751 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-767effbd-8356-4da4-83ce-0cbd7e876974 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Image pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:21:30.802405 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-767effbd-8356-4da4-83ce-0cbd7e876974 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:21:30.822386 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-767effbd-8356-4da4-83ce-0cbd7e876974 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:30.824315 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-767effbd-8356-4da4-83ce-0cbd7e876974 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:30.826568 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-767effbd-8356-4da4-83ce-0cbd7e876974 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:30.828683 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-767effbd-8356-4da4-83ce-0cbd7e876974 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:30.895079 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-767effbd-8356-4da4-83ce-0cbd7e876974 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Getting quotas for project a4cdbc8211774d9fb8b9dbf7e3f1f080. Resources: {'cores', 'instances', 'ram'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:21:30.934438 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-767effbd-8356-4da4-83ce-0cbd7e876974 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Getting quotas for user f998e8e291e942f3a088abe00f0b7c79 and project a4cdbc8211774d9fb8b9dbf7e3f1f080. Resources: {'cores', 'instances', 'ram'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:21:30.998608 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-767effbd-8356-4da4-83ce-0cbd7e876974 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Going to run 1 instances... {{(pid=116084) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:21:31.003233 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-767effbd-8356-4da4-83ce-0cbd7e876974 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: bb8ad3f4-a466-4385-9311-93476fe7304e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b72b5f54-34d0-48ac-9484-bc8104a6dddb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116084) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:21:31.017800 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-46f17e21-805e-448f-aabd-0920678689a8 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff15ede3a4f04e48bea87424ba6424ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaba77899e64379bebe94bb60ec1876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:31.026833 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-46f17e21-805e-448f-aabd-0920678689a8 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] 10.222.0.60 "GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159" status: 200 len: 1314 microversion: 2.1 time: 0.984317 Dec 15 16:21:31.040145 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 16/31] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:30 2021] GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159 => generated 1314 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:31.040145 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-a400977c-59c9-4c3d-ac28-95153f2bf4db tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:31.040145 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-a400977c-59c9-4c3d-ac28-95153f2bf4db tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: 365b5223-e068-4113-abe1-797e13f5e901] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:31.045415 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a400977c-59c9-4c3d-ac28-95153f2bf4db tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:31.045882 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a400977c-59c9-4c3d-ac28-95153f2bf4db tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:31.046722 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a400977c-59c9-4c3d-ac28-95153f2bf4db tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:31.047166 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a400977c-59c9-4c3d-ac28-95153f2bf4db tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:31.196039 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-767effbd-8356-4da4-83ce-0cbd7e876974 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.576330 Dec 15 16:21:31.197756 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 16/32] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Dec 15 16:21:28 2021] POST /compute/v2.1/servers => generated 383 bytes in 2582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 16:21:31.240278 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-3c688c51-b678-4697-b8b6-b092933cb206 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:31.248268 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-3c688c51-b678-4697-b8b6-b092933cb206 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: bb8ad3f4-a466-4385-9311-93476fe7304e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:31.526707 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-3c688c51-b678-4697-b8b6-b092933cb206 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:31.541276 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-a400977c-59c9-4c3d-ac28-95153f2bf4db tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:31.542606 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-3c688c51-b678-4697-b8b6-b092933cb206 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e" status: 200 len: 1222 microversion: 2.1 time: 0.336068 Dec 15 16:21:31.545937 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 17/33] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:31 2021] GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e => generated 1222 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:31.558646 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-a400977c-59c9-4c3d-ac28-95153f2bf4db tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901" status: 200 len: 1318 microversion: 2.1 time: 0.525148 Dec 15 16:21:31.563076 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 17/34] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:31 2021] GET /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901 => generated 1318 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:32.047647 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ca88e488-8342-4073-a029-45d4d7d81256 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:32.049613 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ca88e488-8342-4073-a029-45d4d7d81256 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] [instance: 619e9cc8-266e-47ae-a393-2140979be159] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:32.060631 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ca88e488-8342-4073-a029-45d4d7d81256 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:32.060631 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ca88e488-8342-4073-a029-45d4d7d81256 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:32.061322 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ca88e488-8342-4073-a029-45d4d7d81256 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:32.061753 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ca88e488-8342-4073-a029-45d4d7d81256 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:32.422404 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ca88e488-8342-4073-a029-45d4d7d81256 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff15ede3a4f04e48bea87424ba6424ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaba77899e64379bebe94bb60ec1876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:32.434500 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ca88e488-8342-4073-a029-45d4d7d81256 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] 10.222.0.60 "GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159" status: 200 len: 1314 microversion: 2.1 time: 0.390642 Dec 15 16:21:32.436002 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 18/35] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:32 2021] GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159 => generated 1314 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:21:32.572959 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-4bad1302-10ee-4c72-ac9c-275bd40a48b6 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:32.573817 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-4bad1302-10ee-4c72-ac9c-275bd40a48b6 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: bb8ad3f4-a466-4385-9311-93476fe7304e] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:32.582919 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1b614b11-681d-4fc9-8d62-6541abfa2926 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:32.583715 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1b614b11-681d-4fc9-8d62-6541abfa2926 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: 365b5223-e068-4113-abe1-797e13f5e901] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:32.587222 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4bad1302-10ee-4c72-ac9c-275bd40a48b6 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:32.588884 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4bad1302-10ee-4c72-ac9c-275bd40a48b6 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:32.591139 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4bad1302-10ee-4c72-ac9c-275bd40a48b6 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:32.593326 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4bad1302-10ee-4c72-ac9c-275bd40a48b6 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:32.604635 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1b614b11-681d-4fc9-8d62-6541abfa2926 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:32.607977 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1b614b11-681d-4fc9-8d62-6541abfa2926 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:32.626073 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1b614b11-681d-4fc9-8d62-6541abfa2926 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:32.631404 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1b614b11-681d-4fc9-8d62-6541abfa2926 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:32.752690 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-4bad1302-10ee-4c72-ac9c-275bd40a48b6 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:32.766932 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-4bad1302-10ee-4c72-ac9c-275bd40a48b6 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e" status: 200 len: 1218 microversion: 2.1 time: 0.200866 Dec 15 16:21:32.773486 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 18/36] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:32 2021] GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e => generated 1218 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:33.046544 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1b614b11-681d-4fc9-8d62-6541abfa2926 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:33.067131 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1b614b11-681d-4fc9-8d62-6541abfa2926 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901" status: 200 len: 1318 microversion: 2.1 time: 0.486552 Dec 15 16:21:33.072568 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 19/37] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:32 2021] GET /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901 => generated 1318 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:21:33.218869 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-7602fd33-d2c6-4c59-99a7-c3c7457a360b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-502997853", "imageRef": "b72b5f54-34d0-48ac-9484-bc8104a6dddb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "514727e8-0179-4c06-9ef8-e0775da37a12"}], "security_groups": [{"name": "tempest-securitygroup--1389662162"}], "key_name": "tempest-keypair-123014102", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:21:33.406471 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.network.neutron [None req-7602fd33-d2c6-4c59-99a7-c3c7457a360b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] validate_networks() for [('514727e8-0179-4c06-9ef8-e0775da37a12', None, None, None, None, None)] {{(pid=116085) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:21:33.454805 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d51f4e22-9c92-4b1b-926e-44a4b59efdf3 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:33.456522 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d51f4e22-9c92-4b1b-926e-44a4b59efdf3 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] [instance: 619e9cc8-266e-47ae-a393-2140979be159] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:33.464851 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d51f4e22-9c92-4b1b-926e-44a4b59efdf3 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:33.466023 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d51f4e22-9c92-4b1b-926e-44a4b59efdf3 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:33.467308 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d51f4e22-9c92-4b1b-926e-44a4b59efdf3 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:33.468055 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d51f4e22-9c92-4b1b-926e-44a4b59efdf3 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:33.878342 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d51f4e22-9c92-4b1b-926e-44a4b59efdf3 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff15ede3a4f04e48bea87424ba6424ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaba77899e64379bebe94bb60ec1876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:33.886537 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d51f4e22-9c92-4b1b-926e-44a4b59efdf3 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] 10.222.0.60 "GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159" status: 200 len: 1314 microversion: 2.1 time: 0.436604 Dec 15 16:21:33.887864 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 20/38] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:33 2021] GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159 => generated 1314 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:33.896982 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c568e071-c407-4a09-b98b-5d0c94cb6006 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:33.898013 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c568e071-c407-4a09-b98b-5d0c94cb6006 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: bb8ad3f4-a466-4385-9311-93476fe7304e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:33.907157 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c568e071-c407-4a09-b98b-5d0c94cb6006 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:33.908037 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c568e071-c407-4a09-b98b-5d0c94cb6006 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:33.909264 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c568e071-c407-4a09-b98b-5d0c94cb6006 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:33.910621 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c568e071-c407-4a09-b98b-5d0c94cb6006 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:34.042917 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-c568e071-c407-4a09-b98b-5d0c94cb6006 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:34.056006 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c568e071-c407-4a09-b98b-5d0c94cb6006 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e" status: 200 len: 1274 microversion: 2.1 time: 0.166750 Dec 15 16:21:34.056658 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 21/39] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:33 2021] GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e => generated 1274 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:34.090167 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-9d11fa31-cfa0-4595-a2ab-dd15fcf2d1de tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:34.090924 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-9d11fa31-cfa0-4595-a2ab-dd15fcf2d1de tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: 365b5223-e068-4113-abe1-797e13f5e901] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:34.100463 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9d11fa31-cfa0-4595-a2ab-dd15fcf2d1de tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:34.102962 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9d11fa31-cfa0-4595-a2ab-dd15fcf2d1de tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:34.107037 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9d11fa31-cfa0-4595-a2ab-dd15fcf2d1de tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:34.109173 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9d11fa31-cfa0-4595-a2ab-dd15fcf2d1de tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:34.722025 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-7602fd33-d2c6-4c59-99a7-c3c7457a360b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Flavor limits 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:21:34.723565 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-7602fd33-d2c6-4c59-99a7-c3c7457a360b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Image limits 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:21:34.724328 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-7602fd33-d2c6-4c59-99a7-c3c7457a360b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Flavor pref 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:21:34.725108 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-7602fd33-d2c6-4c59-99a7-c3c7457a360b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Image pref 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:21:34.725905 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-7602fd33-d2c6-4c59-99a7-c3c7457a360b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:21:34.744458 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7602fd33-d2c6-4c59-99a7-c3c7457a360b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:34.746036 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7602fd33-d2c6-4c59-99a7-c3c7457a360b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:34.750890 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-9d11fa31-cfa0-4595-a2ab-dd15fcf2d1de tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:34.751760 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7602fd33-d2c6-4c59-99a7-c3c7457a360b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:34.752447 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7602fd33-d2c6-4c59-99a7-c3c7457a360b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:34.762196 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-9d11fa31-cfa0-4595-a2ab-dd15fcf2d1de tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901" status: 200 len: 1318 microversion: 2.1 time: 0.676703 Dec 15 16:21:34.762914 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 22/40] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:34 2021] GET /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901 => generated 1318 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:21:34.777152 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-7602fd33-d2c6-4c59-99a7-c3c7457a360b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Getting quotas for project 28737128a7574d248ba7e4e536171af2. Resources: {'cores', 'instances', 'ram'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:21:34.782993 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-7602fd33-d2c6-4c59-99a7-c3c7457a360b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Getting quotas for user 99b3403e60df4fbd9a5fdffe01a5efb7 and project 28737128a7574d248ba7e4e536171af2. Resources: {'cores', 'instances', 'ram'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:21:34.795767 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-7602fd33-d2c6-4c59-99a7-c3c7457a360b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Going to run 1 instances... {{(pid=116085) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:21:34.798198 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-7602fd33-d2c6-4c59-99a7-c3c7457a360b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b72b5f54-34d0-48ac-9484-bc8104a6dddb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116085) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:21:34.859218 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-7602fd33-d2c6-4c59-99a7-c3c7457a360b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.645533 Dec 15 16:21:34.860886 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 19/41] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Dec 15 16:21:33 2021] POST /compute/v2.1/servers => generated 402 bytes in 1648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 16:21:34.874745 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-a0645323-a20c-4f34-ab78-54ff6f1e4b73 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:34.876495 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-a0645323-a20c-4f34-ab78-54ff6f1e4b73 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:34.912658 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-b98227eb-1916-4c92-8248-9b926a244e42 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:34.913413 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-b98227eb-1916-4c92-8248-9b926a244e42 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] [instance: 619e9cc8-266e-47ae-a393-2140979be159] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:34.928366 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b98227eb-1916-4c92-8248-9b926a244e42 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:34.928815 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b98227eb-1916-4c92-8248-9b926a244e42 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:34.929617 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b98227eb-1916-4c92-8248-9b926a244e42 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:34.930051 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b98227eb-1916-4c92-8248-9b926a244e42 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:34.967647 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-a0645323-a20c-4f34-ab78-54ff6f1e4b73 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:34.978692 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-a0645323-a20c-4f34-ab78-54ff6f1e4b73 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1236 microversion: 2.1 time: 0.108110 Dec 15 16:21:34.980184 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 23/42] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:34 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1236 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:35.099553 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-42e4894d-1cec-4d37-8e3a-1b28ba5561de tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:35.100198 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-42e4894d-1cec-4d37-8e3a-1b28ba5561de tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: bb8ad3f4-a466-4385-9311-93476fe7304e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:35.129830 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-42e4894d-1cec-4d37-8e3a-1b28ba5561de tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:35.137296 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-42e4894d-1cec-4d37-8e3a-1b28ba5561de tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:35.138166 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-42e4894d-1cec-4d37-8e3a-1b28ba5561de tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:35.138615 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-42e4894d-1cec-4d37-8e3a-1b28ba5561de tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:35.193895 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-b98227eb-1916-4c92-8248-9b926a244e42 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff15ede3a4f04e48bea87424ba6424ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaba77899e64379bebe94bb60ec1876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:35.202274 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-b98227eb-1916-4c92-8248-9b926a244e42 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] 10.222.0.60 "GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159" status: 200 len: 1314 microversion: 2.1 time: 0.294944 Dec 15 16:21:35.203421 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 20/43] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:34 2021] GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:21:35.241399 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-42e4894d-1cec-4d37-8e3a-1b28ba5561de tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:35.250559 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-42e4894d-1cec-4d37-8e3a-1b28ba5561de tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e" status: 200 len: 1274 microversion: 2.1 time: 0.169691 Dec 15 16:21:35.251694 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 24/44] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:35 2021] GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e => generated 1274 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:21:35.789500 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-dfc883ea-995b-40e3-a951-35e6ec9f3122 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:35.791688 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-dfc883ea-995b-40e3-a951-35e6ec9f3122 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: 365b5223-e068-4113-abe1-797e13f5e901] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:35.806079 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-dfc883ea-995b-40e3-a951-35e6ec9f3122 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:35.807864 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-dfc883ea-995b-40e3-a951-35e6ec9f3122 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:35.812001 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-dfc883ea-995b-40e3-a951-35e6ec9f3122 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:35.814637 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-dfc883ea-995b-40e3-a951-35e6ec9f3122 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:36.001355 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-461b6336-efc5-46fe-9f6b-7fd3dd01c0fd tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:36.010558 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-461b6336-efc5-46fe-9f6b-7fd3dd01c0fd tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:36.044998 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-461b6336-efc5-46fe-9f6b-7fd3dd01c0fd tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:36.061525 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-461b6336-efc5-46fe-9f6b-7fd3dd01c0fd tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:36.063000 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-461b6336-efc5-46fe-9f6b-7fd3dd01c0fd tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:36.073954 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-461b6336-efc5-46fe-9f6b-7fd3dd01c0fd tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:36.463064 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-461b6336-efc5-46fe-9f6b-7fd3dd01c0fd tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:36.489134 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-461b6336-efc5-46fe-9f6b-7fd3dd01c0fd tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1232 microversion: 2.1 time: 0.491438 Dec 15 16:21:36.495491 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 25/45] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:35 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1232 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:21:36.509638 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b119bc80-ce09-4d0a-ac2d-415bc1d4f989 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:36.515782 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b119bc80-ce09-4d0a-ac2d-415bc1d4f989 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] [instance: 619e9cc8-266e-47ae-a393-2140979be159] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:36.534237 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-dfc883ea-995b-40e3-a951-35e6ec9f3122 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:36.543699 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b119bc80-ce09-4d0a-ac2d-415bc1d4f989 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:36.544872 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-dfc883ea-995b-40e3-a951-35e6ec9f3122 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901" status: 200 len: 1318 microversion: 2.1 time: 0.759400 Dec 15 16:21:36.545847 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b119bc80-ce09-4d0a-ac2d-415bc1d4f989 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:36.546610 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 21/46] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:35 2021] GET /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901 => generated 1318 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:36.551480 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b119bc80-ce09-4d0a-ac2d-415bc1d4f989 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:36.552455 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b119bc80-ce09-4d0a-ac2d-415bc1d4f989 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:36.560542 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-740c01b2-bacd-4808-b0dc-f5908194881f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:36.561661 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-740c01b2-bacd-4808-b0dc-f5908194881f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: bb8ad3f4-a466-4385-9311-93476fe7304e] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:36.578075 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-740c01b2-bacd-4808-b0dc-f5908194881f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:36.578763 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-740c01b2-bacd-4808-b0dc-f5908194881f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:36.591745 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-740c01b2-bacd-4808-b0dc-f5908194881f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:36.592566 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-740c01b2-bacd-4808-b0dc-f5908194881f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:36.790657 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b119bc80-ce09-4d0a-ac2d-415bc1d4f989 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff15ede3a4f04e48bea87424ba6424ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaba77899e64379bebe94bb60ec1876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:36.804466 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b119bc80-ce09-4d0a-ac2d-415bc1d4f989 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] 10.222.0.60 "GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159" status: 200 len: 1314 microversion: 2.1 time: 0.305446 Dec 15 16:21:36.805435 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 26/47] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:36 2021] GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159 => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:36.861239 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-740c01b2-bacd-4808-b0dc-f5908194881f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:36.875604 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-740c01b2-bacd-4808-b0dc-f5908194881f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e" status: 200 len: 1292 microversion: 2.1 time: 0.327007 Dec 15 16:21:36.879050 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 22/48] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:36 2021] GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e => generated 1292 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:37.528345 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d83eeed0-cd45-4d7b-a34d-5cc877220545 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:37.529104 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d83eeed0-cd45-4d7b-a34d-5cc877220545 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:37.538800 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d83eeed0-cd45-4d7b-a34d-5cc877220545 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:37.539580 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d83eeed0-cd45-4d7b-a34d-5cc877220545 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:37.540574 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d83eeed0-cd45-4d7b-a34d-5cc877220545 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:37.541599 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d83eeed0-cd45-4d7b-a34d-5cc877220545 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:37.565989 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-834f36dd-c1f9-4608-a03a-180a12224c54 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:37.566912 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-834f36dd-c1f9-4608-a03a-180a12224c54 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: 365b5223-e068-4113-abe1-797e13f5e901] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:37.574747 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-834f36dd-c1f9-4608-a03a-180a12224c54 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:37.575560 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-834f36dd-c1f9-4608-a03a-180a12224c54 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:37.576816 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-834f36dd-c1f9-4608-a03a-180a12224c54 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:37.588847 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-834f36dd-c1f9-4608-a03a-180a12224c54 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:37.725200 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d83eeed0-cd45-4d7b-a34d-5cc877220545 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:37.761615 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d83eeed0-cd45-4d7b-a34d-5cc877220545 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1294 microversion: 2.1 time: 0.242342 Dec 15 16:21:37.768612 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 27/49] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:37 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1294 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:37.834867 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0cf8384b-6915-412a-8d27-165c1d1ecafd tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:37.836140 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-0cf8384b-6915-412a-8d27-165c1d1ecafd tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] [instance: 619e9cc8-266e-47ae-a393-2140979be159] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:37.849459 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0cf8384b-6915-412a-8d27-165c1d1ecafd tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:37.849848 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0cf8384b-6915-412a-8d27-165c1d1ecafd tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:37.850603 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0cf8384b-6915-412a-8d27-165c1d1ecafd tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:37.851033 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0cf8384b-6915-412a-8d27-165c1d1ecafd tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:37.932516 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-834f36dd-c1f9-4608-a03a-180a12224c54 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:37.957816 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-834f36dd-c1f9-4608-a03a-180a12224c54 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901" status: 200 len: 1318 microversion: 2.1 time: 0.397079 Dec 15 16:21:37.959210 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 23/50] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:37 2021] GET /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901 => generated 1318 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:37.964129 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-05bc53b1-4f54-4ffd-987c-b897d80d9f9d tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:37.965015 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-05bc53b1-4f54-4ffd-987c-b897d80d9f9d tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: bb8ad3f4-a466-4385-9311-93476fe7304e] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:37.988361 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-05bc53b1-4f54-4ffd-987c-b897d80d9f9d tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:37.990997 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-05bc53b1-4f54-4ffd-987c-b897d80d9f9d tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:37.992186 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-05bc53b1-4f54-4ffd-987c-b897d80d9f9d tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:37.992837 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-05bc53b1-4f54-4ffd-987c-b897d80d9f9d tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:38.174793 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-05bc53b1-4f54-4ffd-987c-b897d80d9f9d tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:38.191263 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-0cf8384b-6915-412a-8d27-165c1d1ecafd tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff15ede3a4f04e48bea87424ba6424ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaba77899e64379bebe94bb60ec1876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:38.192277 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-05bc53b1-4f54-4ffd-987c-b897d80d9f9d tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e" status: 200 len: 1280 microversion: 2.1 time: 0.231705 Dec 15 16:21:38.193211 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 24/51] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:37 2021] GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e => generated 1280 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:38.222070 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0cf8384b-6915-412a-8d27-165c1d1ecafd tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] 10.222.0.60 "GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159" status: 200 len: 1314 microversion: 2.1 time: 0.390555 Dec 15 16:21:38.226493 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 28/52] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:37 2021] GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159 => generated 1314 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:21:38.313747 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-cbd0ba02-3916-4f28-a036-503ee6f39a1e req-a38339e6-e29f-43ae-9417-929c324623e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "129b3afd-1d85-4f6e-94c3-8e7a729ff532", "tag": "61eaf140-62eb-493c-b139-fe292101564e"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:21:38.321681 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:21:38.321681 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Dec 15 16:21:38.345280 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-cbd0ba02-3916-4f28-a036-503ee6f39a1e req-a38339e6-e29f-43ae-9417-929c324623e9 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:38.345738 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-cbd0ba02-3916-4f28-a036-503ee6f39a1e req-a38339e6-e29f-43ae-9417-929c324623e9 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:38.370310 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-cbd0ba02-3916-4f28-a036-503ee6f39a1e req-a38339e6-e29f-43ae-9417-929c324623e9 service nova] Creating event network-changed:61eaf140-62eb-493c-b139-fe292101564e for instance 129b3afd-1d85-4f6e-94c3-8e7a729ff532 on hv-cinder-81268 Dec 15 16:21:38.380110 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-cbd0ba02-3916-4f28-a036-503ee6f39a1e req-a38339e6-e29f-43ae-9417-929c324623e9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068362 Dec 15 16:21:38.382804 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 25/53] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:21:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:21:38.791828 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-fe84b789-f2a4-4b39-9f54-c6827f7f3ca9 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:38.793911 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-fe84b789-f2a4-4b39-9f54-c6827f7f3ca9 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:38.813824 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fe84b789-f2a4-4b39-9f54-c6827f7f3ca9 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:38.823072 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fe84b789-f2a4-4b39-9f54-c6827f7f3ca9 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:38.824909 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fe84b789-f2a4-4b39-9f54-c6827f7f3ca9 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:38.825933 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fe84b789-f2a4-4b39-9f54-c6827f7f3ca9 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:38.969525 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-fe84b789-f2a4-4b39-9f54-c6827f7f3ca9 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:38.979659 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-fe84b789-f2a4-4b39-9f54-c6827f7f3ca9 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1294 microversion: 2.1 time: 0.194271 Dec 15 16:21:38.980243 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 29/54] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:38 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1294 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:38.980688 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-947fc6da-7542-4bf8-afb6-0da170580785 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:38.982290 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-947fc6da-7542-4bf8-afb6-0da170580785 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: 365b5223-e068-4113-abe1-797e13f5e901] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:38.996059 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-947fc6da-7542-4bf8-afb6-0da170580785 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:38.997404 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-947fc6da-7542-4bf8-afb6-0da170580785 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:39.000739 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-947fc6da-7542-4bf8-afb6-0da170580785 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:39.001421 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-947fc6da-7542-4bf8-afb6-0da170580785 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:39.263935 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-947fc6da-7542-4bf8-afb6-0da170580785 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:39.284387 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-947fc6da-7542-4bf8-afb6-0da170580785 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901" status: 200 len: 1318 microversion: 2.1 time: 0.309309 Dec 15 16:21:39.297986 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 26/55] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:38 2021] GET /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901 => generated 1318 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:39.307284 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-b02b7f34-1d5c-4842-829a-438d8ccd0b79 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:39.307944 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-b02b7f34-1d5c-4842-829a-438d8ccd0b79 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: bb8ad3f4-a466-4385-9311-93476fe7304e] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:39.326375 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b02b7f34-1d5c-4842-829a-438d8ccd0b79 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:39.327005 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b02b7f34-1d5c-4842-829a-438d8ccd0b79 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:39.329902 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b02b7f34-1d5c-4842-829a-438d8ccd0b79 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:39.330596 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b02b7f34-1d5c-4842-829a-438d8ccd0b79 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:39.442241 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-7c44a441-d54d-43aa-b9b6-8778930da50a req-d90eee12-7e2a-49ff-96e4-609aebab2afe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "619e9cc8-266e-47ae-a393-2140979be159", "name": "network-vif-plugged", "status": "completed", "tag": "bdc0e4f8-fd70-4efb-be09-06ef2ca1e701"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:21:39.444065 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:21:39.444065 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:21:39.453296 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-7c44a441-d54d-43aa-b9b6-8778930da50a req-d90eee12-7e2a-49ff-96e4-609aebab2afe service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:39.453765 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-7c44a441-d54d-43aa-b9b6-8778930da50a req-d90eee12-7e2a-49ff-96e4-609aebab2afe service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:39.469311 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-7c44a441-d54d-43aa-b9b6-8778930da50a req-d90eee12-7e2a-49ff-96e4-609aebab2afe service nova] Creating event network-vif-plugged:bdc0e4f8-fd70-4efb-be09-06ef2ca1e701 for instance 619e9cc8-266e-47ae-a393-2140979be159 on hv-cinder-81268 Dec 15 16:21:39.477633 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-7c44a441-d54d-43aa-b9b6-8778930da50a req-d90eee12-7e2a-49ff-96e4-609aebab2afe service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.384770 Dec 15 16:21:39.478616 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 30/56] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:21:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:21:39.486135 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-142c1a47-019a-467b-ada2-e0ab71493b9e tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:39.487687 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-142c1a47-019a-467b-ada2-e0ab71493b9e tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] [instance: 619e9cc8-266e-47ae-a393-2140979be159] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:39.497390 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-142c1a47-019a-467b-ada2-e0ab71493b9e tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:39.498272 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-142c1a47-019a-467b-ada2-e0ab71493b9e tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:39.499570 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-142c1a47-019a-467b-ada2-e0ab71493b9e tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:39.500237 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-142c1a47-019a-467b-ada2-e0ab71493b9e tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:39.785761 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-b02b7f34-1d5c-4842-829a-438d8ccd0b79 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:39.796720 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-b02b7f34-1d5c-4842-829a-438d8ccd0b79 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e" status: 200 len: 1322 microversion: 2.1 time: 0.497298 Dec 15 16:21:39.797541 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 27/57] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:39 2021] GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e => generated 1322 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:39.997103 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-142c1a47-019a-467b-ada2-e0ab71493b9e tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff15ede3a4f04e48bea87424ba6424ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaba77899e64379bebe94bb60ec1876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:40.001004 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-22830fd5-b00c-4e56-b517-948a49a092da tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:40.004522 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-22830fd5-b00c-4e56-b517-948a49a092da tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:40.011800 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-142c1a47-019a-467b-ada2-e0ab71493b9e tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] 10.222.0.60 "GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159" status: 200 len: 1314 microversion: 2.1 time: 0.531253 Dec 15 16:21:40.012416 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 31/58] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:39 2021] GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159 => generated 1314 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:40.020340 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-22830fd5-b00c-4e56-b517-948a49a092da tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:40.035188 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-22830fd5-b00c-4e56-b517-948a49a092da tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:40.037679 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-22830fd5-b00c-4e56-b517-948a49a092da tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:40.038802 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-22830fd5-b00c-4e56-b517-948a49a092da tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:40.189338 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-22830fd5-b00c-4e56-b517-948a49a092da tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:40.202616 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-22830fd5-b00c-4e56-b517-948a49a092da tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1294 microversion: 2.1 time: 0.209829 Dec 15 16:21:40.203320 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 28/59] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:39 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1294 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:21:40.301935 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-24caa3f1-9fc8-4209-8e4b-2daff1652d1b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:40.302811 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-24caa3f1-9fc8-4209-8e4b-2daff1652d1b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: 365b5223-e068-4113-abe1-797e13f5e901] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:40.310166 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-24caa3f1-9fc8-4209-8e4b-2daff1652d1b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:40.310851 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-24caa3f1-9fc8-4209-8e4b-2daff1652d1b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:40.312488 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-24caa3f1-9fc8-4209-8e4b-2daff1652d1b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:40.313194 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-24caa3f1-9fc8-4209-8e4b-2daff1652d1b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:40.819020 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-624ae53c-74c6-4477-be2c-1ce350814018 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:40.820256 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-624ae53c-74c6-4477-be2c-1ce350814018 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: bb8ad3f4-a466-4385-9311-93476fe7304e] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:40.832260 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-624ae53c-74c6-4477-be2c-1ce350814018 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:40.834161 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-624ae53c-74c6-4477-be2c-1ce350814018 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:40.836008 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-624ae53c-74c6-4477-be2c-1ce350814018 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:40.837458 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-624ae53c-74c6-4477-be2c-1ce350814018 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:40.838114 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-24caa3f1-9fc8-4209-8e4b-2daff1652d1b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:40.867475 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-24caa3f1-9fc8-4209-8e4b-2daff1652d1b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901" status: 200 len: 1318 microversion: 2.1 time: 0.568844 Dec 15 16:21:40.872772 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 32/60] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:40 2021] GET /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901 => generated 1318 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:41.040920 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-135d3795-803b-45ab-8f5d-0a5a2f912f61 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:41.041541 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-135d3795-803b-45ab-8f5d-0a5a2f912f61 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] [instance: 619e9cc8-266e-47ae-a393-2140979be159] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:41.048714 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-135d3795-803b-45ab-8f5d-0a5a2f912f61 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:41.049779 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-135d3795-803b-45ab-8f5d-0a5a2f912f61 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:41.050787 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-135d3795-803b-45ab-8f5d-0a5a2f912f61 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:41.051307 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-135d3795-803b-45ab-8f5d-0a5a2f912f61 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:41.648005 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-624ae53c-74c6-4477-be2c-1ce350814018 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:41.673179 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-624ae53c-74c6-4477-be2c-1ce350814018 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e" status: 200 len: 1322 microversion: 2.1 time: 0.861435 Dec 15 16:21:41.674493 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 29/61] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:40 2021] GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e => generated 1322 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:41.688689 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-4b059e3e-9013-4088-a118-f1daa457b870 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:41.690883 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-4b059e3e-9013-4088-a118-f1daa457b870 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:41.711030 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4b059e3e-9013-4088-a118-f1daa457b870 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:41.711769 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4b059e3e-9013-4088-a118-f1daa457b870 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:41.712901 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4b059e3e-9013-4088-a118-f1daa457b870 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:41.713482 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4b059e3e-9013-4088-a118-f1daa457b870 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:41.996438 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-135d3795-803b-45ab-8f5d-0a5a2f912f61 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff15ede3a4f04e48bea87424ba6424ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaba77899e64379bebe94bb60ec1876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:42.011722 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-135d3795-803b-45ab-8f5d-0a5a2f912f61 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] 10.222.0.60 "GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159" status: 200 len: 1314 microversion: 2.1 time: 0.974529 Dec 15 16:21:42.013036 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 33/62] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:41 2021] GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159 => generated 1314 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:42.023084 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-88f0e03e-67f8-423f-a511-47b0329e2422 req-53802b64-f221-43f0-b5eb-bc7e30b710c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "365b5223-e068-4113-abe1-797e13f5e901", "name": "network-vif-plugged", "status": "completed", "tag": "2a99c3c6-1c76-4557-ba21-b6d579694eac"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:21:42.026255 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:21:42.026255 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:21:42.040940 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-88f0e03e-67f8-423f-a511-47b0329e2422 req-53802b64-f221-43f0-b5eb-bc7e30b710c1 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:42.042812 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-88f0e03e-67f8-423f-a511-47b0329e2422 req-53802b64-f221-43f0-b5eb-bc7e30b710c1 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:42.063265 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-88f0e03e-67f8-423f-a511-47b0329e2422 req-53802b64-f221-43f0-b5eb-bc7e30b710c1 service nova] Creating event network-vif-plugged:2a99c3c6-1c76-4557-ba21-b6d579694eac for instance 365b5223-e068-4113-abe1-797e13f5e901 on hv-cinder-81268 Dec 15 16:21:42.073281 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-88f0e03e-67f8-423f-a511-47b0329e2422 req-53802b64-f221-43f0-b5eb-bc7e30b710c1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058079 Dec 15 16:21:42.074705 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 34/63] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:21:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:21:42.088249 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0e061bc7-e261-495c-8c30-ebbf1fff4d08 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:42.089514 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-0e061bc7-e261-495c-8c30-ebbf1fff4d08 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: 365b5223-e068-4113-abe1-797e13f5e901] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:42.099176 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0e061bc7-e261-495c-8c30-ebbf1fff4d08 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:42.100122 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0e061bc7-e261-495c-8c30-ebbf1fff4d08 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:42.101358 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0e061bc7-e261-495c-8c30-ebbf1fff4d08 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:42.102046 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0e061bc7-e261-495c-8c30-ebbf1fff4d08 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:42.666919 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-4b059e3e-9013-4088-a118-f1daa457b870 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:42.682001 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-4b059e3e-9013-4088-a118-f1daa457b870 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1362 microversion: 2.1 time: 1.005720 Dec 15 16:21:42.687753 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 30/64] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:41 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1362 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:42.697840 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-3d2d5ae6-e6e6-44bc-a942-87f51ca8bcfb req-e2f82ca7-74f8-47e7-9ade-32fe26c9df08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb8ad3f4-a466-4385-9311-93476fe7304e", "tag": "103425f9-977f-478d-a146-0888d66b4144"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:21:42.700275 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:21:42.700275 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Dec 15 16:21:42.722266 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-3d2d5ae6-e6e6-44bc-a942-87f51ca8bcfb req-e2f82ca7-74f8-47e7-9ade-32fe26c9df08 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:42.725600 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-3d2d5ae6-e6e6-44bc-a942-87f51ca8bcfb req-e2f82ca7-74f8-47e7-9ade-32fe26c9df08 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:42.753396 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-3d2d5ae6-e6e6-44bc-a942-87f51ca8bcfb req-e2f82ca7-74f8-47e7-9ade-32fe26c9df08 service nova] Creating event network-changed:103425f9-977f-478d-a146-0888d66b4144 for instance bb8ad3f4-a466-4385-9311-93476fe7304e on hv-cinder-81268 Dec 15 16:21:42.769579 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-3d2d5ae6-e6e6-44bc-a942-87f51ca8bcfb req-e2f82ca7-74f8-47e7-9ade-32fe26c9df08 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073399 Dec 15 16:21:42.770280 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 31/65] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:21:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:21:42.791985 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-ceb93bf3-77a7-44ae-9950-2c582fb376c3 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:42.792701 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-ceb93bf3-77a7-44ae-9950-2c582fb376c3 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: bb8ad3f4-a466-4385-9311-93476fe7304e] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:42.813573 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ceb93bf3-77a7-44ae-9950-2c582fb376c3 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:42.813573 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ceb93bf3-77a7-44ae-9950-2c582fb376c3 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:42.813573 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ceb93bf3-77a7-44ae-9950-2c582fb376c3 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:42.813573 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ceb93bf3-77a7-44ae-9950-2c582fb376c3 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:43.031415 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-0e061bc7-e261-495c-8c30-ebbf1fff4d08 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:43.048573 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0e061bc7-e261-495c-8c30-ebbf1fff4d08 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901" status: 200 len: 1318 microversion: 2.1 time: 0.966713 Dec 15 16:21:43.049493 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 35/66] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:42 2021] GET /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901 => generated 1318 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:43.069970 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-3fdd9ab3-9bd3-478a-a4de-1fbeeb4af711 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:43.070756 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-3fdd9ab3-9bd3-478a-a4de-1fbeeb4af711 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] [instance: 619e9cc8-266e-47ae-a393-2140979be159] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:43.083655 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3fdd9ab3-9bd3-478a-a4de-1fbeeb4af711 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:43.084432 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3fdd9ab3-9bd3-478a-a4de-1fbeeb4af711 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:43.086129 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3fdd9ab3-9bd3-478a-a4de-1fbeeb4af711 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:43.087622 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3fdd9ab3-9bd3-478a-a4de-1fbeeb4af711 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:43.514020 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-ceb93bf3-77a7-44ae-9950-2c582fb376c3 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:43.534063 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-ceb93bf3-77a7-44ae-9950-2c582fb376c3 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e" status: 200 len: 1322 microversion: 2.1 time: 0.751932 Dec 15 16:21:43.541778 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 32/67] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:42 2021] GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e => generated 1322 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:43.726307 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-a0c40d8c-da23-4c0c-b033-bc47f4108b7f tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:43.732943 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-a0c40d8c-da23-4c0c-b033-bc47f4108b7f tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:43.796661 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a0c40d8c-da23-4c0c-b033-bc47f4108b7f tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:43.797720 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a0c40d8c-da23-4c0c-b033-bc47f4108b7f tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:43.800485 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a0c40d8c-da23-4c0c-b033-bc47f4108b7f tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:43.809838 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a0c40d8c-da23-4c0c-b033-bc47f4108b7f tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:44.241221 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-3fdd9ab3-9bd3-478a-a4de-1fbeeb4af711 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff15ede3a4f04e48bea87424ba6424ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaba77899e64379bebe94bb60ec1876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:44.270732 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-3fdd9ab3-9bd3-478a-a4de-1fbeeb4af711 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] 10.222.0.60 "GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159" status: 200 len: 1314 microversion: 2.1 time: 1.212343 Dec 15 16:21:44.274021 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 36/68] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:43 2021] GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159 => generated 1314 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:44.294644 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-913a78cb-d143-402e-a77b-20b0584c5cb4 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:44.301104 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-913a78cb-d143-402e-a77b-20b0584c5cb4 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: 365b5223-e068-4113-abe1-797e13f5e901] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:44.332576 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-913a78cb-d143-402e-a77b-20b0584c5cb4 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:44.333127 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-913a78cb-d143-402e-a77b-20b0584c5cb4 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:44.334228 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-913a78cb-d143-402e-a77b-20b0584c5cb4 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:44.337747 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-913a78cb-d143-402e-a77b-20b0584c5cb4 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:44.760203 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-a0c40d8c-da23-4c0c-b033-bc47f4108b7f tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:44.786909 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-a0c40d8c-da23-4c0c-b033-bc47f4108b7f tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1362 microversion: 2.1 time: 1.062129 Dec 15 16:21:44.787967 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 33/69] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:43 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1362 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:44.793939 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-02fe8dc9-e1f7-4727-ac16-33e7b2509ff5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:44.801535 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-02fe8dc9-e1f7-4727-ac16-33e7b2509ff5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: bb8ad3f4-a466-4385-9311-93476fe7304e] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:44.820141 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-02fe8dc9-e1f7-4727-ac16-33e7b2509ff5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:44.821843 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-02fe8dc9-e1f7-4727-ac16-33e7b2509ff5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:44.822870 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-02fe8dc9-e1f7-4727-ac16-33e7b2509ff5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:44.825606 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-02fe8dc9-e1f7-4727-ac16-33e7b2509ff5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:44.830602 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-913a78cb-d143-402e-a77b-20b0584c5cb4 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:44.850583 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-913a78cb-d143-402e-a77b-20b0584c5cb4 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901" status: 200 len: 1318 microversion: 2.1 time: 0.564456 Dec 15 16:21:44.851485 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 37/70] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:44 2021] GET /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901 => generated 1318 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:45.382007 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-02fe8dc9-e1f7-4727-ac16-33e7b2509ff5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:45.390807 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-02fe8dc9-e1f7-4727-ac16-33e7b2509ff5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e" status: 200 len: 1322 microversion: 2.1 time: 0.601158 Dec 15 16:21:45.395526 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 34/71] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:44 2021] GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e => generated 1322 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:45.401026 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-b88ca95c-01b3-42ab-bdfb-1a55da69d3c9 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:45.403803 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-b88ca95c-01b3-42ab-bdfb-1a55da69d3c9 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] [instance: 619e9cc8-266e-47ae-a393-2140979be159] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:45.424841 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b88ca95c-01b3-42ab-bdfb-1a55da69d3c9 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:45.425623 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b88ca95c-01b3-42ab-bdfb-1a55da69d3c9 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:45.426523 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b88ca95c-01b3-42ab-bdfb-1a55da69d3c9 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:45.430106 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b88ca95c-01b3-42ab-bdfb-1a55da69d3c9 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:45.522850 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-bf8af7b2-e6ab-4d4c-acd7-d2c65875f7a5 req-4cca0d98-2925-475e-80f6-d9c295eb4ddd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f48359cf-b1e0-4786-885d-3aa339bbf38a", "tag": "65d0d9cf-d833-47a5-8f8a-740b194ba7ff"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:21:45.525295 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:21:45.525295 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:21:45.540830 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-bf8af7b2-e6ab-4d4c-acd7-d2c65875f7a5 req-4cca0d98-2925-475e-80f6-d9c295eb4ddd service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:45.541533 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-bf8af7b2-e6ab-4d4c-acd7-d2c65875f7a5 req-4cca0d98-2925-475e-80f6-d9c295eb4ddd service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:45.559586 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-bf8af7b2-e6ab-4d4c-acd7-d2c65875f7a5 req-4cca0d98-2925-475e-80f6-d9c295eb4ddd service nova] Creating event network-changed:65d0d9cf-d833-47a5-8f8a-740b194ba7ff for instance f48359cf-b1e0-4786-885d-3aa339bbf38a on hv-cinder-81268 Dec 15 16:21:45.566224 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-bf8af7b2-e6ab-4d4c-acd7-d2c65875f7a5 req-4cca0d98-2925-475e-80f6-d9c295eb4ddd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.405327 Dec 15 16:21:45.567418 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 38/72] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:21:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:21:45.792410 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-b88ca95c-01b3-42ab-bdfb-1a55da69d3c9 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff15ede3a4f04e48bea87424ba6424ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaba77899e64379bebe94bb60ec1876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:45.806015 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-b88ca95c-01b3-42ab-bdfb-1a55da69d3c9 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] 10.222.0.60 "GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159" status: 200 len: 1500 microversion: 2.1 time: 0.408643 Dec 15 16:21:45.807019 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 35/73] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:45 2021] GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159 => generated 1500 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:45.814809 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-51457672-eeb4-419c-95d2-774315a4d2cb tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:45.815838 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-51457672-eeb4-419c-95d2-774315a4d2cb tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:45.836052 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-51457672-eeb4-419c-95d2-774315a4d2cb tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:45.837179 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-51457672-eeb4-419c-95d2-774315a4d2cb tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:45.838821 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-51457672-eeb4-419c-95d2-774315a4d2cb tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:45.839691 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-51457672-eeb4-419c-95d2-774315a4d2cb tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:45.871694 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-cfa8e4ed-091e-4ab3-aa6b-674b0186a34f tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:45.872315 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-cfa8e4ed-091e-4ab3-aa6b-674b0186a34f tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: 365b5223-e068-4113-abe1-797e13f5e901] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:45.882444 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-cfa8e4ed-091e-4ab3-aa6b-674b0186a34f tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:45.882894 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-cfa8e4ed-091e-4ab3-aa6b-674b0186a34f tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:45.883743 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-cfa8e4ed-091e-4ab3-aa6b-674b0186a34f tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:45.886488 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-cfa8e4ed-091e-4ab3-aa6b-674b0186a34f tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:46.108945 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-51457672-eeb4-419c-95d2-774315a4d2cb tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:46.117396 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-51457672-eeb4-419c-95d2-774315a4d2cb tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1362 microversion: 2.1 time: 0.308785 Dec 15 16:21:46.118627 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 39/74] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:45 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1362 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:46.123694 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-cfa8e4ed-091e-4ab3-aa6b-674b0186a34f tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:46.131394 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-cfa8e4ed-091e-4ab3-aa6b-674b0186a34f tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901" status: 200 len: 1507 microversion: 2.1 time: 0.263844 Dec 15 16:21:46.132135 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 36/75] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:45 2021] GET /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901 => generated 1507 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:21:46.420785 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-2b2b5428-6b97-444c-aae3-52268a9b70d9 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:46.421388 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-2b2b5428-6b97-444c-aae3-52268a9b70d9 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: bb8ad3f4-a466-4385-9311-93476fe7304e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:46.431209 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2b2b5428-6b97-444c-aae3-52268a9b70d9 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:46.432040 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2b2b5428-6b97-444c-aae3-52268a9b70d9 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:46.433495 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2b2b5428-6b97-444c-aae3-52268a9b70d9 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:46.434279 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2b2b5428-6b97-444c-aae3-52268a9b70d9 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:46.619223 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-2b2b5428-6b97-444c-aae3-52268a9b70d9 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:46.635701 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-2b2b5428-6b97-444c-aae3-52268a9b70d9 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e" status: 200 len: 1322 microversion: 2.1 time: 0.218313 Dec 15 16:21:46.638170 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 40/76] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:46 2021] GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:21:47.076533 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-545a90d2-3331-4bab-b686-16a74a856128 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-781784563", "imageRef": "b72b5f54-34d0-48ac-9484-bc8104a6dddb", "flavorRef": "452", "networks": [{"uuid": "719c9634-9007-4e20-b3e0-eba40acf400f"}]}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:21:47.135860 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-74aea1d3-95c1-4d1d-a937-1e881b405e54 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:47.136460 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-74aea1d3-95c1-4d1d-a937-1e881b405e54 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:47.143046 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-74aea1d3-95c1-4d1d-a937-1e881b405e54 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:47.143856 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-74aea1d3-95c1-4d1d-a937-1e881b405e54 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:47.144815 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-74aea1d3-95c1-4d1d-a937-1e881b405e54 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:47.145540 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-74aea1d3-95c1-4d1d-a937-1e881b405e54 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:47.196044 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.network.neutron [None req-545a90d2-3331-4bab-b686-16a74a856128 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] validate_networks() for [('719c9634-9007-4e20-b3e0-eba40acf400f', None, None, None, None, None)] {{(pid=116085) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:21:47.469228 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-74aea1d3-95c1-4d1d-a937-1e881b405e54 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:47.477867 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-74aea1d3-95c1-4d1d-a937-1e881b405e54 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1362 microversion: 2.1 time: 0.345529 Dec 15 16:21:47.478469 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 41/77] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:47 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1362 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:21:47.658273 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-bfeb7337-6293-44a0-8ceb-ad1ac24451e5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:47.659305 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-bfeb7337-6293-44a0-8ceb-ad1ac24451e5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: bb8ad3f4-a466-4385-9311-93476fe7304e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:47.669465 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bfeb7337-6293-44a0-8ceb-ad1ac24451e5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:47.670175 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bfeb7337-6293-44a0-8ceb-ad1ac24451e5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:47.671756 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bfeb7337-6293-44a0-8ceb-ad1ac24451e5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:47.672477 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bfeb7337-6293-44a0-8ceb-ad1ac24451e5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:47.776694 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-545a90d2-3331-4bab-b686-16a74a856128 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Flavor limits 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:21:47.777814 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-545a90d2-3331-4bab-b686-16a74a856128 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Image limits 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:21:47.778951 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-545a90d2-3331-4bab-b686-16a74a856128 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Flavor pref 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:21:47.780039 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-545a90d2-3331-4bab-b686-16a74a856128 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Image pref 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:21:47.781039 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-545a90d2-3331-4bab-b686-16a74a856128 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:21:47.800211 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-545a90d2-3331-4bab-b686-16a74a856128 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:47.801326 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-545a90d2-3331-4bab-b686-16a74a856128 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:47.802957 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-545a90d2-3331-4bab-b686-16a74a856128 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:47.803965 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-545a90d2-3331-4bab-b686-16a74a856128 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:47.830324 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-545a90d2-3331-4bab-b686-16a74a856128 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Getting quotas for project 6c056527e8db4053b789853fcf928010. Resources: {'cores', 'instances', 'ram'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:21:47.839362 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-545a90d2-3331-4bab-b686-16a74a856128 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Getting quotas for user 3bb9f7ee83454ee38fd6d0ef1db12c18 and project 6c056527e8db4053b789853fcf928010. Resources: {'cores', 'instances', 'ram'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:21:47.855748 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-545a90d2-3331-4bab-b686-16a74a856128 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Going to run 1 instances... {{(pid=116085) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:21:47.857456 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-545a90d2-3331-4bab-b686-16a74a856128 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] [instance: f25d9543-b63f-4552-bf8c-633277eb0c58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b72b5f54-34d0-48ac-9484-bc8104a6dddb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116085) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:21:47.905218 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-bfeb7337-6293-44a0-8ceb-ad1ac24451e5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:47.920656 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-bfeb7337-6293-44a0-8ceb-ad1ac24451e5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e" status: 200 len: 1322 microversion: 2.1 time: 0.268825 Dec 15 16:21:47.931897 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 42/78] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:47 2021] GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e => generated 1322 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:47.941656 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-545a90d2-3331-4bab-b686-16a74a856128 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.871597 Dec 15 16:21:47.948665 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 37/79] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Dec 15 16:21:47 2021] POST /compute/v2.1/servers => generated 380 bytes in 876 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 15 16:21:47.967682 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-5b8b1521-13f1-4021-907a-e0294134078f tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:47.973008 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-5b8b1521-13f1-4021-907a-e0294134078f tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] [instance: f25d9543-b63f-4552-bf8c-633277eb0c58] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:48.042077 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-5b8b1521-13f1-4021-907a-e0294134078f tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb9f7ee83454ee38fd6d0ef1db12c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c056527e8db4053b789853fcf928010', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:48.051690 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-5b8b1521-13f1-4021-907a-e0294134078f tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] 10.222.0.60 "GET /compute/v2.1/servers/f25d9543-b63f-4552-bf8c-633277eb0c58" status: 200 len: 1213 microversion: 2.1 time: 0.100962 Dec 15 16:21:48.052294 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 43/80] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:47 2021] GET /compute/v2.1/servers/f25d9543-b63f-4552-bf8c-633277eb0c58 => generated 1213 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:48.501392 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-fba15cd2-0faa-4209-81cb-54b0399e7eb2 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:48.503535 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-fba15cd2-0faa-4209-81cb-54b0399e7eb2 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:48.517140 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fba15cd2-0faa-4209-81cb-54b0399e7eb2 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:48.518056 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fba15cd2-0faa-4209-81cb-54b0399e7eb2 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:48.519634 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fba15cd2-0faa-4209-81cb-54b0399e7eb2 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:48.520474 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fba15cd2-0faa-4209-81cb-54b0399e7eb2 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:48.855265 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-fba15cd2-0faa-4209-81cb-54b0399e7eb2 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:48.864626 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-fba15cd2-0faa-4209-81cb-54b0399e7eb2 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1362 microversion: 2.1 time: 0.370852 Dec 15 16:21:48.866248 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 38/81] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:48 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1362 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:49.000258 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-fbc7a8e2-1c0f-4112-ae74-ecd388cdb524 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:49.000874 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-fbc7a8e2-1c0f-4112-ae74-ecd388cdb524 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: bb8ad3f4-a466-4385-9311-93476fe7304e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:49.017623 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fbc7a8e2-1c0f-4112-ae74-ecd388cdb524 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:49.018474 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fbc7a8e2-1c0f-4112-ae74-ecd388cdb524 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:49.019781 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fbc7a8e2-1c0f-4112-ae74-ecd388cdb524 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:49.021073 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fbc7a8e2-1c0f-4112-ae74-ecd388cdb524 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:49.023749 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-cf3d58b8-d1f4-4569-b438-3bf1bc1918a6 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ba26767-3001-4965-8128-4e617f1f422f"}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:21:49.025293 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-cf3d58b8-d1f4-4569-b438-3bf1bc1918a6 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] [instance: 619e9cc8-266e-47ae-a393-2140979be159] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:49.039154 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-cf3d58b8-d1f4-4569-b438-3bf1bc1918a6 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:49.040207 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-cf3d58b8-d1f4-4569-b438-3bf1bc1918a6 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:49.043098 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-cf3d58b8-d1f4-4569-b438-3bf1bc1918a6 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:49.043960 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-cf3d58b8-d1f4-4569-b438-3bf1bc1918a6 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:49.563430 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-fbc7a8e2-1c0f-4112-ae74-ecd388cdb524 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:49.578474 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-fbc7a8e2-1c0f-4112-ae74-ecd388cdb524 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e" status: 200 len: 1322 microversion: 2.1 time: 0.582944 Dec 15 16:21:49.591728 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 44/82] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:48 2021] GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e => generated 1322 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:49.602385 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-731a7d1d-d7e6-4af4-a456-8a6348d3a359 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:49.604212 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-731a7d1d-d7e6-4af4-a456-8a6348d3a359 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] [instance: f25d9543-b63f-4552-bf8c-633277eb0c58] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:49.624546 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-731a7d1d-d7e6-4af4-a456-8a6348d3a359 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:49.627654 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-731a7d1d-d7e6-4af4-a456-8a6348d3a359 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:49.628705 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-731a7d1d-d7e6-4af4-a456-8a6348d3a359 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:49.629253 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-731a7d1d-d7e6-4af4-a456-8a6348d3a359 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:49.813240 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-731a7d1d-d7e6-4af4-a456-8a6348d3a359 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb9f7ee83454ee38fd6d0ef1db12c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c056527e8db4053b789853fcf928010', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:49.823945 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-731a7d1d-d7e6-4af4-a456-8a6348d3a359 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] 10.222.0.60 "GET /compute/v2.1/servers/f25d9543-b63f-4552-bf8c-633277eb0c58" status: 200 len: 1271 microversion: 2.1 time: 0.238654 Dec 15 16:21:49.825497 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 45/83] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:49 2021] GET /compute/v2.1/servers/f25d9543-b63f-4552-bf8c-633277eb0c58 => generated 1271 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:49.832109 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-9a7d5ac5-7968-478f-ba14-e780151843d3 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bcfb1e1d-47b3-4883-8a5b-104597a6b3af"}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:21:49.833616 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-9a7d5ac5-7968-478f-ba14-e780151843d3 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: 365b5223-e068-4113-abe1-797e13f5e901] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:49.840429 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9a7d5ac5-7968-478f-ba14-e780151843d3 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:49.841288 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9a7d5ac5-7968-478f-ba14-e780151843d3 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:49.842316 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9a7d5ac5-7968-478f-ba14-e780151843d3 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:49.842835 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9a7d5ac5-7968-478f-ba14-e780151843d3 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:49.945992 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-cf3d58b8-d1f4-4569-b438-3bf1bc1918a6 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] 10.222.0.60 "POST /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.929055 Dec 15 16:21:49.947662 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 39/84] 10.222.0.60 () {60 vars in 1322 bytes} [Wed Dec 15 16:21:49 2021] POST /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159/os-volume_attachments => generated 194 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:21:49.967276 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-f5d6acab-3c83-43aa-b97a-597df06d5d5d tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:49.975512 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-f5d6acab-3c83-43aa-b97a-597df06d5d5d tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:49.985323 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f5d6acab-3c83-43aa-b97a-597df06d5d5d tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:49.987116 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f5d6acab-3c83-43aa-b97a-597df06d5d5d tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:49.988295 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f5d6acab-3c83-43aa-b97a-597df06d5d5d tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:49.988919 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f5d6acab-3c83-43aa-b97a-597df06d5d5d tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:50.171689 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-f5d6acab-3c83-43aa-b97a-597df06d5d5d tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:50.184728 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-f5d6acab-3c83-43aa-b97a-597df06d5d5d tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1362 microversion: 2.1 time: 0.235155 Dec 15 16:21:50.185615 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 40/85] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:49 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1362 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:50.600829 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-2b64b54a-3cb7-4970-bdd4-aee21b1e13f3 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:50.602373 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-2b64b54a-3cb7-4970-bdd4-aee21b1e13f3 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: bb8ad3f4-a466-4385-9311-93476fe7304e] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:50.624112 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2b64b54a-3cb7-4970-bdd4-aee21b1e13f3 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:50.624962 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2b64b54a-3cb7-4970-bdd4-aee21b1e13f3 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:50.626088 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2b64b54a-3cb7-4970-bdd4-aee21b1e13f3 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:50.629144 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2b64b54a-3cb7-4970-bdd4-aee21b1e13f3 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:50.829217 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-2b64b54a-3cb7-4970-bdd4-aee21b1e13f3 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:50.838340 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-2b64b54a-3cb7-4970-bdd4-aee21b1e13f3 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e" status: 200 len: 1322 microversion: 2.1 time: 0.243027 Dec 15 16:21:50.838948 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 41/86] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:50 2021] GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e => generated 1322 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:21:50.843917 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-d2a686d2-3146-481f-9774-e3e6f9ff2611 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:50.844750 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-d2a686d2-3146-481f-9774-e3e6f9ff2611 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] [instance: f25d9543-b63f-4552-bf8c-633277eb0c58] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:50.852344 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d2a686d2-3146-481f-9774-e3e6f9ff2611 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:50.852831 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d2a686d2-3146-481f-9774-e3e6f9ff2611 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:50.854005 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d2a686d2-3146-481f-9774-e3e6f9ff2611 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:50.854425 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d2a686d2-3146-481f-9774-e3e6f9ff2611 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:51.069454 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-d2a686d2-3146-481f-9774-e3e6f9ff2611 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb9f7ee83454ee38fd6d0ef1db12c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c056527e8db4053b789853fcf928010', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:51.077123 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-d2a686d2-3146-481f-9774-e3e6f9ff2611 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] 10.222.0.60 "GET /compute/v2.1/servers/f25d9543-b63f-4552-bf8c-633277eb0c58" status: 200 len: 1313 microversion: 2.1 time: 0.236999 Dec 15 16:21:51.077722 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 42/87] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:50 2021] GET /compute/v2.1/servers/f25d9543-b63f-4552-bf8c-633277eb0c58 => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:51.206131 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-3fe9f6f3-f551-4e3c-bd52-1a20b29f154d tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:51.206756 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-3fe9f6f3-f551-4e3c-bd52-1a20b29f154d tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:51.212767 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3fe9f6f3-f551-4e3c-bd52-1a20b29f154d tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:51.213216 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3fe9f6f3-f551-4e3c-bd52-1a20b29f154d tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:51.214009 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3fe9f6f3-f551-4e3c-bd52-1a20b29f154d tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:51.214444 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3fe9f6f3-f551-4e3c-bd52-1a20b29f154d tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:51.365911 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-3fe9f6f3-f551-4e3c-bd52-1a20b29f154d tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:51.374797 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-3fe9f6f3-f551-4e3c-bd52-1a20b29f154d tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1362 microversion: 2.1 time: 0.172908 Dec 15 16:21:51.375409 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 43/88] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:51 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:21:51.858380 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-f71cb42f-fb9d-477d-9a9f-9041ee775c54 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:51.859279 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-f71cb42f-fb9d-477d-9a9f-9041ee775c54 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: bb8ad3f4-a466-4385-9311-93476fe7304e] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:51.867536 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f71cb42f-fb9d-477d-9a9f-9041ee775c54 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:51.867991 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f71cb42f-fb9d-477d-9a9f-9041ee775c54 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:51.868793 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f71cb42f-fb9d-477d-9a9f-9041ee775c54 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:51.869222 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f71cb42f-fb9d-477d-9a9f-9041ee775c54 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:52.027423 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-f71cb42f-fb9d-477d-9a9f-9041ee775c54 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:52.035842 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-f71cb42f-fb9d-477d-9a9f-9041ee775c54 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e" status: 200 len: 1322 microversion: 2.1 time: 0.183337 Dec 15 16:21:52.036435 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 44/89] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:51 2021] GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:21:52.103186 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-16ef6bcf-92ee-4ad2-ad99-912c866715c0 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:52.104260 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-16ef6bcf-92ee-4ad2-ad99-912c866715c0 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] [instance: f25d9543-b63f-4552-bf8c-633277eb0c58] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:52.111195 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-16ef6bcf-92ee-4ad2-ad99-912c866715c0 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:52.112090 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-16ef6bcf-92ee-4ad2-ad99-912c866715c0 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:52.113914 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-16ef6bcf-92ee-4ad2-ad99-912c866715c0 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:52.114546 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-16ef6bcf-92ee-4ad2-ad99-912c866715c0 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:52.277439 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-16ef6bcf-92ee-4ad2-ad99-912c866715c0 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb9f7ee83454ee38fd6d0ef1db12c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c056527e8db4053b789853fcf928010', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:52.285169 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-16ef6bcf-92ee-4ad2-ad99-912c866715c0 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] 10.222.0.60 "GET /compute/v2.1/servers/f25d9543-b63f-4552-bf8c-633277eb0c58" status: 200 len: 1313 microversion: 2.1 time: 0.186308 Dec 15 16:21:52.285795 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 45/90] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:52 2021] GET /compute/v2.1/servers/f25d9543-b63f-4552-bf8c-633277eb0c58 => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:21:52.400192 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-d46ffd00-c27c-4c45-a43a-bd05aa319344 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:52.401095 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-d46ffd00-c27c-4c45-a43a-bd05aa319344 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:52.409165 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d46ffd00-c27c-4c45-a43a-bd05aa319344 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:52.409711 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d46ffd00-c27c-4c45-a43a-bd05aa319344 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:52.410639 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d46ffd00-c27c-4c45-a43a-bd05aa319344 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:52.411137 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d46ffd00-c27c-4c45-a43a-bd05aa319344 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:52.557048 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-d46ffd00-c27c-4c45-a43a-bd05aa319344 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:52.565477 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-d46ffd00-c27c-4c45-a43a-bd05aa319344 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1362 microversion: 2.1 time: 0.170582 Dec 15 16:21:52.566112 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 46/91] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:52 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:21:52.858037 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-9a7d5ac5-7968-478f-ba14-e780151843d3 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "POST /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.031057 Dec 15 16:21:52.861663 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 46/92] 10.222.0.60 () {60 vars in 1322 bytes} [Wed Dec 15 16:21:49 2021] POST /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901/os-volume_attachments => generated 194 bytes in 3035 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:21:53.046813 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-7751b3a8-0865-4e7a-bbb8-c8dead601739 req-c187d83e-5ca9-47dd-86f2-8f54ee861d4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb8ad3f4-a466-4385-9311-93476fe7304e", "name": "network-vif-plugged", "status": "completed", "tag": "103425f9-977f-478d-a146-0888d66b4144"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:21:53.069700 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-6b236197-3e33-40e6-a4c1-431ceb1d8bbc tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:53.070150 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:21:53.070150 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Dec 15 16:21:53.077793 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-6b236197-3e33-40e6-a4c1-431ceb1d8bbc tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: bb8ad3f4-a466-4385-9311-93476fe7304e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:53.102904 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-7751b3a8-0865-4e7a-bbb8-c8dead601739 req-c187d83e-5ca9-47dd-86f2-8f54ee861d4a service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:53.107633 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-7751b3a8-0865-4e7a-bbb8-c8dead601739 req-c187d83e-5ca9-47dd-86f2-8f54ee861d4a service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:53.112497 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6b236197-3e33-40e6-a4c1-431ceb1d8bbc tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:53.113247 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6b236197-3e33-40e6-a4c1-431ceb1d8bbc tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:53.114266 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6b236197-3e33-40e6-a4c1-431ceb1d8bbc tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:53.114855 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6b236197-3e33-40e6-a4c1-431ceb1d8bbc tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:53.141919 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-7751b3a8-0865-4e7a-bbb8-c8dead601739 req-c187d83e-5ca9-47dd-86f2-8f54ee861d4a service nova] Creating event network-vif-plugged:103425f9-977f-478d-a146-0888d66b4144 for instance bb8ad3f4-a466-4385-9311-93476fe7304e on hv-cinder-81268 Dec 15 16:21:53.151484 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-7751b3a8-0865-4e7a-bbb8-c8dead601739 req-c187d83e-5ca9-47dd-86f2-8f54ee861d4a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120067 Dec 15 16:21:53.155208 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 47/93] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:21:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:21:53.321568 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-b0220b10-4c9e-4dd0-83fa-2d61451f8aa3 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:53.322329 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-b0220b10-4c9e-4dd0-83fa-2d61451f8aa3 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] [instance: f25d9543-b63f-4552-bf8c-633277eb0c58] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:53.341305 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b0220b10-4c9e-4dd0-83fa-2d61451f8aa3 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:53.341753 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b0220b10-4c9e-4dd0-83fa-2d61451f8aa3 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:53.342545 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b0220b10-4c9e-4dd0-83fa-2d61451f8aa3 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:53.342972 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b0220b10-4c9e-4dd0-83fa-2d61451f8aa3 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:53.352677 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-6b236197-3e33-40e6-a4c1-431ceb1d8bbc tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:53.365209 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-6b236197-3e33-40e6-a4c1-431ceb1d8bbc tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e" status: 200 len: 1322 microversion: 2.1 time: 0.311895 Dec 15 16:21:53.366568 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 47/94] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:53 2021] GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e => generated 1322 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:53.584920 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-3a8e1c78-202a-4a6b-ba1a-4f70a8ce7ab4 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:53.585545 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-3a8e1c78-202a-4a6b-ba1a-4f70a8ce7ab4 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:53.612038 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3a8e1c78-202a-4a6b-ba1a-4f70a8ce7ab4 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:53.612478 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3a8e1c78-202a-4a6b-ba1a-4f70a8ce7ab4 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:53.613371 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3a8e1c78-202a-4a6b-ba1a-4f70a8ce7ab4 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:53.613803 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3a8e1c78-202a-4a6b-ba1a-4f70a8ce7ab4 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:53.765797 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-b0220b10-4c9e-4dd0-83fa-2d61451f8aa3 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb9f7ee83454ee38fd6d0ef1db12c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c056527e8db4053b789853fcf928010', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:53.774267 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-b0220b10-4c9e-4dd0-83fa-2d61451f8aa3 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] 10.222.0.60 "GET /compute/v2.1/servers/f25d9543-b63f-4552-bf8c-633277eb0c58" status: 200 len: 1313 microversion: 2.1 time: 0.474811 Dec 15 16:21:53.774822 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 48/95] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:53 2021] GET /compute/v2.1/servers/f25d9543-b63f-4552-bf8c-633277eb0c58 => generated 1313 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:53.793456 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-245da084-83a4-4c5d-b269-744a636a7ea2 req-b13d40d5-b54b-4401-af70-d761ab789576 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f25d9543-b63f-4552-bf8c-633277eb0c58", "tag": "c68e21af-42be-4707-8908-9b6e83c71a44"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:21:53.795028 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:21:53.795028 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Dec 15 16:21:53.809275 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-245da084-83a4-4c5d-b269-744a636a7ea2 req-b13d40d5-b54b-4401-af70-d761ab789576 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:53.809897 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-245da084-83a4-4c5d-b269-744a636a7ea2 req-b13d40d5-b54b-4401-af70-d761ab789576 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:53.825206 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-245da084-83a4-4c5d-b269-744a636a7ea2 req-b13d40d5-b54b-4401-af70-d761ab789576 service nova] Creating event network-changed:c68e21af-42be-4707-8908-9b6e83c71a44 for instance f25d9543-b63f-4552-bf8c-633277eb0c58 on hv-cinder-81268 Dec 15 16:21:53.832135 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-245da084-83a4-4c5d-b269-744a636a7ea2 req-b13d40d5-b54b-4401-af70-d761ab789576 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044494 Dec 15 16:21:53.833349 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 49/96] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:21:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:21:53.866151 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-3a8e1c78-202a-4a6b-ba1a-4f70a8ce7ab4 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:53.873751 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-3a8e1c78-202a-4a6b-ba1a-4f70a8ce7ab4 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1362 microversion: 2.1 time: 0.295516 Dec 15 16:21:53.874323 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 48/97] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:53 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1362 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:21:54.394673 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-7969ed20-388a-4891-8d1c-8ff6320818ad tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:54.396064 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-7969ed20-388a-4891-8d1c-8ff6320818ad tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: bb8ad3f4-a466-4385-9311-93476fe7304e] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:54.408080 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7969ed20-388a-4891-8d1c-8ff6320818ad tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:54.409224 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7969ed20-388a-4891-8d1c-8ff6320818ad tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:54.410912 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7969ed20-388a-4891-8d1c-8ff6320818ad tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:54.411662 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7969ed20-388a-4891-8d1c-8ff6320818ad tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:54.638083 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-7969ed20-388a-4891-8d1c-8ff6320818ad tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:54.648586 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-7969ed20-388a-4891-8d1c-8ff6320818ad tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e" status: 200 len: 1322 microversion: 2.1 time: 0.269151 Dec 15 16:21:54.652634 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 50/98] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:54 2021] GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e => generated 1322 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:54.793116 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-948cac82-5473-4065-ba10-c0badd0d11cf tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:54.794058 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-948cac82-5473-4065-ba10-c0badd0d11cf tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] [instance: f25d9543-b63f-4552-bf8c-633277eb0c58] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:54.802477 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-948cac82-5473-4065-ba10-c0badd0d11cf tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:54.803430 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-948cac82-5473-4065-ba10-c0badd0d11cf tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:54.804614 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-948cac82-5473-4065-ba10-c0badd0d11cf tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:54.805487 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-948cac82-5473-4065-ba10-c0badd0d11cf tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:54.892735 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-6ac2add8-a050-4e24-9d1c-9215630e36ec tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:54.893372 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-6ac2add8-a050-4e24-9d1c-9215630e36ec tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:54.922813 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6ac2add8-a050-4e24-9d1c-9215630e36ec tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:54.923487 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6ac2add8-a050-4e24-9d1c-9215630e36ec tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:54.925106 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6ac2add8-a050-4e24-9d1c-9215630e36ec tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:54.926870 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6ac2add8-a050-4e24-9d1c-9215630e36ec tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:55.010111 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-948cac82-5473-4065-ba10-c0badd0d11cf tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb9f7ee83454ee38fd6d0ef1db12c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c056527e8db4053b789853fcf928010', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:55.022612 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-948cac82-5473-4065-ba10-c0badd0d11cf tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] 10.222.0.60 "GET /compute/v2.1/servers/f25d9543-b63f-4552-bf8c-633277eb0c58" status: 200 len: 1313 microversion: 2.1 time: 0.233529 Dec 15 16:21:55.023613 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 49/99] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:54 2021] GET /compute/v2.1/servers/f25d9543-b63f-4552-bf8c-633277eb0c58 => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:55.106487 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-6ac2add8-a050-4e24-9d1c-9215630e36ec tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:55.115733 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-6ac2add8-a050-4e24-9d1c-9215630e36ec tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1362 microversion: 2.1 time: 0.228773 Dec 15 16:21:55.116808 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 51/100] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:54 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1362 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:21:55.198093 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-9693024e-be47-4550-8e29-a557e7ad4693 req-4450b198-8bed-43f3-96b3-cd706d036c5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "129b3afd-1d85-4f6e-94c3-8e7a729ff532", "name": "network-vif-plugged", "status": "completed", "tag": "61eaf140-62eb-493c-b139-fe292101564e"}, {"server_uuid": "f48359cf-b1e0-4786-885d-3aa339bbf38a", "name": "network-vif-plugged", "status": "completed", "tag": "65d0d9cf-d833-47a5-8f8a-740b194ba7ff"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:21:55.199907 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:21:55.199907 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:21:55.208302 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-9693024e-be47-4550-8e29-a557e7ad4693 req-4450b198-8bed-43f3-96b3-cd706d036c5d service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:55.208761 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-9693024e-be47-4550-8e29-a557e7ad4693 req-4450b198-8bed-43f3-96b3-cd706d036c5d service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:55.223172 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-9693024e-be47-4550-8e29-a557e7ad4693 req-4450b198-8bed-43f3-96b3-cd706d036c5d service nova] Creating event network-vif-plugged:61eaf140-62eb-493c-b139-fe292101564e for instance 129b3afd-1d85-4f6e-94c3-8e7a729ff532 on hv-cinder-81268 Dec 15 16:21:55.223813 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-9693024e-be47-4550-8e29-a557e7ad4693 req-4450b198-8bed-43f3-96b3-cd706d036c5d service nova] Creating event network-vif-plugged:65d0d9cf-d833-47a5-8f8a-740b194ba7ff for instance f48359cf-b1e0-4786-885d-3aa339bbf38a on hv-cinder-81268 Dec 15 16:21:55.230679 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-9693024e-be47-4550-8e29-a557e7ad4693 req-4450b198-8bed-43f3-96b3-cd706d036c5d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036325 Dec 15 16:21:55.233738 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 50/101] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:21:55 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:21:55.675781 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-95d97d35-aea1-42a8-a24b-ed36585a601d tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:55.676317 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-95d97d35-aea1-42a8-a24b-ed36585a601d tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: bb8ad3f4-a466-4385-9311-93476fe7304e] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:55.683172 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-95d97d35-aea1-42a8-a24b-ed36585a601d tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:55.683650 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-95d97d35-aea1-42a8-a24b-ed36585a601d tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:55.684429 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-95d97d35-aea1-42a8-a24b-ed36585a601d tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:55.684861 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-95d97d35-aea1-42a8-a24b-ed36585a601d tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:55.854663 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-95d97d35-aea1-42a8-a24b-ed36585a601d tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:55.862299 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-95d97d35-aea1-42a8-a24b-ed36585a601d tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e" status: 200 len: 1322 microversion: 2.1 time: 0.190604 Dec 15 16:21:55.862868 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 52/102] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:55 2021] GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:56.047188 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1ab819d4-3871-43d3-bc7a-0b569d5c322b tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:56.047938 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1ab819d4-3871-43d3-bc7a-0b569d5c322b tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] [instance: f25d9543-b63f-4552-bf8c-633277eb0c58] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:56.055194 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1ab819d4-3871-43d3-bc7a-0b569d5c322b tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:56.055740 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1ab819d4-3871-43d3-bc7a-0b569d5c322b tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:56.056541 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1ab819d4-3871-43d3-bc7a-0b569d5c322b tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:56.056968 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1ab819d4-3871-43d3-bc7a-0b569d5c322b tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:56.135285 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-161aa42f-c9d8-41fb-9da2-849cc36aceba tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:56.136138 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-161aa42f-c9d8-41fb-9da2-849cc36aceba tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:56.143425 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-161aa42f-c9d8-41fb-9da2-849cc36aceba tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:56.143911 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-161aa42f-c9d8-41fb-9da2-849cc36aceba tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:56.144855 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-161aa42f-c9d8-41fb-9da2-849cc36aceba tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:56.145292 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-161aa42f-c9d8-41fb-9da2-849cc36aceba tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:56.249751 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1ab819d4-3871-43d3-bc7a-0b569d5c322b tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb9f7ee83454ee38fd6d0ef1db12c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c056527e8db4053b789853fcf928010', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:56.259856 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1ab819d4-3871-43d3-bc7a-0b569d5c322b tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] 10.222.0.60 "GET /compute/v2.1/servers/f25d9543-b63f-4552-bf8c-633277eb0c58" status: 200 len: 1313 microversion: 2.1 time: 0.217128 Dec 15 16:21:56.260446 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 51/103] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:56 2021] GET /compute/v2.1/servers/f25d9543-b63f-4552-bf8c-633277eb0c58 => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:56.316732 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-161aa42f-c9d8-41fb-9da2-849cc36aceba tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:56.327486 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-161aa42f-c9d8-41fb-9da2-849cc36aceba tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1362 microversion: 2.1 time: 0.196926 Dec 15 16:21:56.328670 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 53/104] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:56 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1362 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:21:56.879673 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1fddb785-a4eb-4481-a775-e2799ced0e64 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:56.880388 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1fddb785-a4eb-4481-a775-e2799ced0e64 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: bb8ad3f4-a466-4385-9311-93476fe7304e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:56.886679 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1fddb785-a4eb-4481-a775-e2799ced0e64 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:56.887123 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1fddb785-a4eb-4481-a775-e2799ced0e64 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:56.887935 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1fddb785-a4eb-4481-a775-e2799ced0e64 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:56.888359 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1fddb785-a4eb-4481-a775-e2799ced0e64 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:57.037083 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1fddb785-a4eb-4481-a775-e2799ced0e64 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:57.045226 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1fddb785-a4eb-4481-a775-e2799ced0e64 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e" status: 200 len: 1322 microversion: 2.1 time: 0.169255 Dec 15 16:21:57.045782 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 52/105] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:56 2021] GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:57.278312 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-4b1c4346-d13d-4b23-9b09-4ae117c816cd tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:57.278889 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-4b1c4346-d13d-4b23-9b09-4ae117c816cd tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] [instance: f25d9543-b63f-4552-bf8c-633277eb0c58] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:57.285875 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4b1c4346-d13d-4b23-9b09-4ae117c816cd tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:57.286249 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4b1c4346-d13d-4b23-9b09-4ae117c816cd tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:57.287035 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4b1c4346-d13d-4b23-9b09-4ae117c816cd tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:57.287510 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4b1c4346-d13d-4b23-9b09-4ae117c816cd tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:57.346538 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-46081c2e-5c7e-44ce-95da-452e47091386 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:57.347138 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-46081c2e-5c7e-44ce-95da-452e47091386 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:57.354128 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-46081c2e-5c7e-44ce-95da-452e47091386 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:57.354579 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-46081c2e-5c7e-44ce-95da-452e47091386 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:57.355392 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-46081c2e-5c7e-44ce-95da-452e47091386 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:57.355828 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-46081c2e-5c7e-44ce-95da-452e47091386 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:57.457711 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-4b1c4346-d13d-4b23-9b09-4ae117c816cd tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb9f7ee83454ee38fd6d0ef1db12c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c056527e8db4053b789853fcf928010', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:57.468768 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-4b1c4346-d13d-4b23-9b09-4ae117c816cd tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] 10.222.0.60 "GET /compute/v2.1/servers/f25d9543-b63f-4552-bf8c-633277eb0c58" status: 200 len: 1313 microversion: 2.1 time: 0.194278 Dec 15 16:21:57.469512 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 54/106] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:57 2021] GET /compute/v2.1/servers/f25d9543-b63f-4552-bf8c-633277eb0c58 => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:57.524169 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-46081c2e-5c7e-44ce-95da-452e47091386 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:57.531813 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-46081c2e-5c7e-44ce-95da-452e47091386 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1362 microversion: 2.1 time: 0.189946 Dec 15 16:21:57.532398 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 53/107] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:57 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1362 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:58.063514 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-43a4ceeb-e8be-49bd-ba2c-b72fcdf99fe1 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:58.064714 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-43a4ceeb-e8be-49bd-ba2c-b72fcdf99fe1 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: bb8ad3f4-a466-4385-9311-93476fe7304e] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:58.078660 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-43a4ceeb-e8be-49bd-ba2c-b72fcdf99fe1 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:58.079735 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-43a4ceeb-e8be-49bd-ba2c-b72fcdf99fe1 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:58.080932 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-43a4ceeb-e8be-49bd-ba2c-b72fcdf99fe1 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:58.081573 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-43a4ceeb-e8be-49bd-ba2c-b72fcdf99fe1 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:58.218233 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-43a4ceeb-e8be-49bd-ba2c-b72fcdf99fe1 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:58.226376 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-43a4ceeb-e8be-49bd-ba2c-b72fcdf99fe1 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e" status: 200 len: 1322 microversion: 2.1 time: 0.167614 Dec 15 16:21:58.226970 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 55/108] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:58 2021] GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:58.486906 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0c4ce1f1-3bb0-40b4-b53a-d32a03804c3f tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:58.487673 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-0c4ce1f1-3bb0-40b4-b53a-d32a03804c3f tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] [instance: f25d9543-b63f-4552-bf8c-633277eb0c58] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:58.496417 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0c4ce1f1-3bb0-40b4-b53a-d32a03804c3f tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:58.496939 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0c4ce1f1-3bb0-40b4-b53a-d32a03804c3f tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:58.497813 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0c4ce1f1-3bb0-40b4-b53a-d32a03804c3f tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:58.498311 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0c4ce1f1-3bb0-40b4-b53a-d32a03804c3f tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:58.558259 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-686eceef-9dba-4170-91fb-e98257112e19 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:58.560624 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-686eceef-9dba-4170-91fb-e98257112e19 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:58.574287 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-686eceef-9dba-4170-91fb-e98257112e19 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:58.575734 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-686eceef-9dba-4170-91fb-e98257112e19 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:58.578348 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-686eceef-9dba-4170-91fb-e98257112e19 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:58.579026 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-686eceef-9dba-4170-91fb-e98257112e19 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:58.692625 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-0c4ce1f1-3bb0-40b4-b53a-d32a03804c3f tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb9f7ee83454ee38fd6d0ef1db12c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c056527e8db4053b789853fcf928010', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:58.702617 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0c4ce1f1-3bb0-40b4-b53a-d32a03804c3f tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] 10.222.0.60 "GET /compute/v2.1/servers/f25d9543-b63f-4552-bf8c-633277eb0c58" status: 200 len: 1313 microversion: 2.1 time: 0.220173 Dec 15 16:21:58.711988 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 54/109] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:58 2021] GET /compute/v2.1/servers/f25d9543-b63f-4552-bf8c-633277eb0c58 => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:58.834765 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-686eceef-9dba-4170-91fb-e98257112e19 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:58.844293 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-686eceef-9dba-4170-91fb-e98257112e19 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1362 microversion: 2.1 time: 0.296593 Dec 15 16:21:58.854800 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 56/110] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:58 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1362 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:59.247530 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0b2580a3-db4e-4bf1-a126-7f0e676e87ef tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:59.248544 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-0b2580a3-db4e-4bf1-a126-7f0e676e87ef tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: bb8ad3f4-a466-4385-9311-93476fe7304e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:59.259225 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0b2580a3-db4e-4bf1-a126-7f0e676e87ef tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:59.259966 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0b2580a3-db4e-4bf1-a126-7f0e676e87ef tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:59.261009 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0b2580a3-db4e-4bf1-a126-7f0e676e87ef tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:59.261547 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0b2580a3-db4e-4bf1-a126-7f0e676e87ef tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:59.462839 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-0b2580a3-db4e-4bf1-a126-7f0e676e87ef tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:21:59.473104 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0b2580a3-db4e-4bf1-a126-7f0e676e87ef tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e" status: 200 len: 1514 microversion: 2.1 time: 0.231949 Dec 15 16:21:59.473893 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 55/111] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:59 2021] GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e => generated 1514 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:21:59.497760 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-1fd8c970-ea9b-4f30-abe2-ecccd4427b94 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:21:59.499167 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-1fd8c970-ea9b-4f30-abe2-ecccd4427b94 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: bb8ad3f4-a466-4385-9311-93476fe7304e] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:59.510483 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1fd8c970-ea9b-4f30-abe2-ecccd4427b94 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:59.511329 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1fd8c970-ea9b-4f30-abe2-ecccd4427b94 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:59.513114 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1fd8c970-ea9b-4f30-abe2-ecccd4427b94 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:59.513879 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1fd8c970-ea9b-4f30-abe2-ecccd4427b94 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:59.542395 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.objects.instance [None req-1fd8c970-ea9b-4f30-abe2-ecccd4427b94 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lazy-loading 'flavor' on Instance uuid bb8ad3f4-a466-4385-9311-93476fe7304e {{(pid=116085) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:21:59.690526 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-1fd8c970-ea9b-4f30-abe2-ecccd4427b94 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "POST /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e/action" status: 200 len: 32 microversion: 2.1 time: 0.200130 Dec 15 16:21:59.692289 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 57/112] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:21:59 2021] POST /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e/action => generated 32 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:21:59.701640 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-a9eb5429-34aa-4ccc-853f-4d243ba314a5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:59.703135 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-a9eb5429-34aa-4ccc-853f-4d243ba314a5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: bb8ad3f4-a466-4385-9311-93476fe7304e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:59.719326 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a9eb5429-34aa-4ccc-853f-4d243ba314a5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:59.720063 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a9eb5429-34aa-4ccc-853f-4d243ba314a5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:59.721144 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a9eb5429-34aa-4ccc-853f-4d243ba314a5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:59.721925 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a9eb5429-34aa-4ccc-853f-4d243ba314a5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:59.727660 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-32fe595b-3d80-4476-8b15-533cf9d5b5d4 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:21:59.737366 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-32fe595b-3d80-4476-8b15-533cf9d5b5d4 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] [instance: f25d9543-b63f-4552-bf8c-633277eb0c58] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:21:59.739767 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-32fe595b-3d80-4476-8b15-533cf9d5b5d4 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:59.740177 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-32fe595b-3d80-4476-8b15-533cf9d5b5d4 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:59.741045 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-32fe595b-3d80-4476-8b15-533cf9d5b5d4 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:21:59.741484 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-32fe595b-3d80-4476-8b15-533cf9d5b5d4 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:21:59.994616 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-32fe595b-3d80-4476-8b15-533cf9d5b5d4 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb9f7ee83454ee38fd6d0ef1db12c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c056527e8db4053b789853fcf928010', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:00.006208 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-32fe595b-3d80-4476-8b15-533cf9d5b5d4 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] 10.222.0.60 "GET /compute/v2.1/servers/f25d9543-b63f-4552-bf8c-633277eb0c58" status: 200 len: 1313 microversion: 2.1 time: 0.283728 Dec 15 16:22:00.007050 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 58/113] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:59 2021] GET /compute/v2.1/servers/f25d9543-b63f-4552-bf8c-633277eb0c58 => generated 1313 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:00.022039 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-5bca3543-7a1d-4fd0-9df2-d3d4dee1ddd8 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:00.023092 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-5bca3543-7a1d-4fd0-9df2-d3d4dee1ddd8 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:00.039104 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5bca3543-7a1d-4fd0-9df2-d3d4dee1ddd8 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:00.039863 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5bca3543-7a1d-4fd0-9df2-d3d4dee1ddd8 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:00.040817 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5bca3543-7a1d-4fd0-9df2-d3d4dee1ddd8 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:00.041401 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5bca3543-7a1d-4fd0-9df2-d3d4dee1ddd8 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:00.052211 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-a9eb5429-34aa-4ccc-853f-4d243ba314a5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:00.061163 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-a9eb5429-34aa-4ccc-853f-4d243ba314a5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e" status: 200 len: 1520 microversion: 2.1 time: 0.363260 Dec 15 16:22:00.065818 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 56/114] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:21:59 2021] GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e => generated 1520 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:00.357143 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-5bca3543-7a1d-4fd0-9df2-d3d4dee1ddd8 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:00.368174 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-5bca3543-7a1d-4fd0-9df2-d3d4dee1ddd8 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1362 microversion: 2.1 time: 0.358253 Dec 15 16:22:00.368910 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 59/115] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:00 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1362 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:01.025902 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e0e3438e-1449-4afa-a920-d0a951ef484b tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:01.027082 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e0e3438e-1449-4afa-a920-d0a951ef484b tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] [instance: f25d9543-b63f-4552-bf8c-633277eb0c58] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:01.039822 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e0e3438e-1449-4afa-a920-d0a951ef484b tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:01.040644 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e0e3438e-1449-4afa-a920-d0a951ef484b tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:01.041675 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e0e3438e-1449-4afa-a920-d0a951ef484b tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:01.042344 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e0e3438e-1449-4afa-a920-d0a951ef484b tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:01.083299 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-9a42e4ff-fe7c-4feb-80cf-1c6d000dc2ad tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:01.083299 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-9a42e4ff-fe7c-4feb-80cf-1c6d000dc2ad tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: bb8ad3f4-a466-4385-9311-93476fe7304e] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:01.089742 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9a42e4ff-fe7c-4feb-80cf-1c6d000dc2ad tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:01.090190 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9a42e4ff-fe7c-4feb-80cf-1c6d000dc2ad tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:01.090975 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9a42e4ff-fe7c-4feb-80cf-1c6d000dc2ad tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:01.091627 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9a42e4ff-fe7c-4feb-80cf-1c6d000dc2ad tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:01.264223 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e0e3438e-1449-4afa-a920-d0a951ef484b tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb9f7ee83454ee38fd6d0ef1db12c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c056527e8db4053b789853fcf928010', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:01.272146 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e0e3438e-1449-4afa-a920-d0a951ef484b tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] 10.222.0.60 "GET /compute/v2.1/servers/f25d9543-b63f-4552-bf8c-633277eb0c58" status: 200 len: 1313 microversion: 2.1 time: 0.251418 Dec 15 16:22:01.272729 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 57/116] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:01 2021] GET /compute/v2.1/servers/f25d9543-b63f-4552-bf8c-633277eb0c58 => generated 1313 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:01.294581 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-9a42e4ff-fe7c-4feb-80cf-1c6d000dc2ad tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:01.303991 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-9a42e4ff-fe7c-4feb-80cf-1c6d000dc2ad tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e" status: 200 len: 1520 microversion: 2.1 time: 0.226202 Dec 15 16:22:01.304515 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 60/117] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:01 2021] GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e => generated 1520 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:01.385522 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-4b3b650c-2eee-4824-802a-6c0e2d917ba4 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:01.386126 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-4b3b650c-2eee-4824-802a-6c0e2d917ba4 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:01.393349 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4b3b650c-2eee-4824-802a-6c0e2d917ba4 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:01.393799 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4b3b650c-2eee-4824-802a-6c0e2d917ba4 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:01.394594 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4b3b650c-2eee-4824-802a-6c0e2d917ba4 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:01.395036 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4b3b650c-2eee-4824-802a-6c0e2d917ba4 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:01.538607 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-4b3b650c-2eee-4824-802a-6c0e2d917ba4 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:01.546892 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-4b3b650c-2eee-4824-802a-6c0e2d917ba4 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1548 microversion: 2.1 time: 0.164936 Dec 15 16:22:01.547510 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 58/118] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:01 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1548 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:01.566274 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-b10a6f09-49c4-4d50-a335-4da4140cb9ee tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:01.566884 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-b10a6f09-49c4-4d50-a335-4da4140cb9ee tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:01.573751 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b10a6f09-49c4-4d50-a335-4da4140cb9ee tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:01.574216 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b10a6f09-49c4-4d50-a335-4da4140cb9ee tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:01.574968 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b10a6f09-49c4-4d50-a335-4da4140cb9ee tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:01.575523 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b10a6f09-49c4-4d50-a335-4da4140cb9ee tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:01.673633 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-b10a6f09-49c4-4d50-a335-4da4140cb9ee tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.111177 Dec 15 16:22:01.674387 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 61/119] 10.222.0.60 () {58 vars in 1274 bytes} [Wed Dec 15 16:22:01 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/os-interface => generated 285 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:22:02.293050 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b005b163-693e-48d1-acd8-ef99e41862d7 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:02.294059 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b005b163-693e-48d1-acd8-ef99e41862d7 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] [instance: f25d9543-b63f-4552-bf8c-633277eb0c58] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:02.305822 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b005b163-693e-48d1-acd8-ef99e41862d7 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:02.306577 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b005b163-693e-48d1-acd8-ef99e41862d7 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:02.308306 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b005b163-693e-48d1-acd8-ef99e41862d7 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:02.309527 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b005b163-693e-48d1-acd8-ef99e41862d7 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:02.337981 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-f8db9654-a076-489a-ac0d-9b5e2e559a6c tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:02.339395 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-f8db9654-a076-489a-ac0d-9b5e2e559a6c tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: bb8ad3f4-a466-4385-9311-93476fe7304e] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:02.348200 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f8db9654-a076-489a-ac0d-9b5e2e559a6c tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:02.352469 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f8db9654-a076-489a-ac0d-9b5e2e559a6c tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:02.354011 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f8db9654-a076-489a-ac0d-9b5e2e559a6c tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:02.354971 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f8db9654-a076-489a-ac0d-9b5e2e559a6c tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:02.826124 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b005b163-693e-48d1-acd8-ef99e41862d7 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb9f7ee83454ee38fd6d0ef1db12c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c056527e8db4053b789853fcf928010', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:02.835795 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-f8db9654-a076-489a-ac0d-9b5e2e559a6c tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:02.838903 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b005b163-693e-48d1-acd8-ef99e41862d7 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] 10.222.0.60 "GET /compute/v2.1/servers/f25d9543-b63f-4552-bf8c-633277eb0c58" status: 200 len: 1313 microversion: 2.1 time: 0.551799 Dec 15 16:22:02.840503 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 59/120] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:02 2021] GET /compute/v2.1/servers/f25d9543-b63f-4552-bf8c-633277eb0c58 => generated 1313 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:02.848069 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-f8db9654-a076-489a-ac0d-9b5e2e559a6c tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e" status: 200 len: 1520 microversion: 2.1 time: 0.517432 Dec 15 16:22:02.849733 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 62/121] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:02 2021] GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e => generated 1520 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:03.371514 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-70d829ca-f893-4e24-91d3-e806c4ae72a6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:03.372515 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-70d829ca-f893-4e24-91d3-e806c4ae72a6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:03.374195 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-1107e620-7bb7-482d-8b26-33ab12a067e9 req-5853675f-c4a2-4864-a761-842476530658 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f48359cf-b1e0-4786-885d-3aa339bbf38a", "tag": "65d0d9cf-d833-47a5-8f8a-740b194ba7ff"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:03.375888 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:22:03.375888 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Dec 15 16:22:03.385240 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-1107e620-7bb7-482d-8b26-33ab12a067e9 req-5853675f-c4a2-4864-a761-842476530658 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:03.385679 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-1107e620-7bb7-482d-8b26-33ab12a067e9 req-5853675f-c4a2-4864-a761-842476530658 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:03.389827 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-70d829ca-f893-4e24-91d3-e806c4ae72a6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:03.390274 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-70d829ca-f893-4e24-91d3-e806c4ae72a6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:03.391264 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-70d829ca-f893-4e24-91d3-e806c4ae72a6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:03.391762 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-70d829ca-f893-4e24-91d3-e806c4ae72a6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:03.399756 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-1107e620-7bb7-482d-8b26-33ab12a067e9 req-5853675f-c4a2-4864-a761-842476530658 service nova] Creating event network-changed:65d0d9cf-d833-47a5-8f8a-740b194ba7ff for instance f48359cf-b1e0-4786-885d-3aa339bbf38a on hv-cinder-81268 Dec 15 16:22:03.405560 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-1107e620-7bb7-482d-8b26-33ab12a067e9 req-5853675f-c4a2-4864-a761-842476530658 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034811 Dec 15 16:22:03.407330 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 63/122] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:22:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:22:03.810751 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-70d829ca-f893-4e24-91d3-e806c4ae72a6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action" status: 200 len: 14 microversion: 2.1 time: 0.442770 Dec 15 16:22:03.815570 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 60/123] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:22:03 2021] POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action => generated 14 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:22:03.865179 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-06a2486c-c9be-4a41-8976-59ac434fdc64 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:03.871476 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-475c1032-afdf-4c5f-a070-a53bae9cd625 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:03.872278 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-475c1032-afdf-4c5f-a070-a53bae9cd625 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: bb8ad3f4-a466-4385-9311-93476fe7304e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:03.874557 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-06a2486c-c9be-4a41-8976-59ac434fdc64 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] [instance: f25d9543-b63f-4552-bf8c-633277eb0c58] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:03.890491 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-475c1032-afdf-4c5f-a070-a53bae9cd625 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:03.891095 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-475c1032-afdf-4c5f-a070-a53bae9cd625 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:03.892409 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-475c1032-afdf-4c5f-a070-a53bae9cd625 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:03.895116 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-475c1032-afdf-4c5f-a070-a53bae9cd625 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:03.902433 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-06a2486c-c9be-4a41-8976-59ac434fdc64 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:03.908731 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-06a2486c-c9be-4a41-8976-59ac434fdc64 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:03.912626 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-06a2486c-c9be-4a41-8976-59ac434fdc64 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:03.913896 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-06a2486c-c9be-4a41-8976-59ac434fdc64 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:04.187459 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-475c1032-afdf-4c5f-a070-a53bae9cd625 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:04.190166 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-06a2486c-c9be-4a41-8976-59ac434fdc64 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb9f7ee83454ee38fd6d0ef1db12c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c056527e8db4053b789853fcf928010', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:04.202405 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-06a2486c-c9be-4a41-8976-59ac434fdc64 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] 10.222.0.60 "GET /compute/v2.1/servers/f25d9543-b63f-4552-bf8c-633277eb0c58" status: 200 len: 1313 microversion: 2.1 time: 0.343642 Dec 15 16:22:04.212655 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 64/124] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:03 2021] GET /compute/v2.1/servers/f25d9543-b63f-4552-bf8c-633277eb0c58 => generated 1313 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:22:04.215612 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-475c1032-afdf-4c5f-a070-a53bae9cd625 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e" status: 200 len: 1520 microversion: 2.1 time: 0.349426 Dec 15 16:22:04.224310 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 61/125] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:03 2021] GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e => generated 1520 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:22:04.823195 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-4afc934d-25e5-4c0b-89ee-e77d51098fbe tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:04.824234 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-4afc934d-25e5-4c0b-89ee-e77d51098fbe tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:04.831304 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4afc934d-25e5-4c0b-89ee-e77d51098fbe tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:04.832012 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4afc934d-25e5-4c0b-89ee-e77d51098fbe tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:04.833009 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4afc934d-25e5-4c0b-89ee-e77d51098fbe tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:04.833601 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4afc934d-25e5-4c0b-89ee-e77d51098fbe tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:04.929876 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-4afc934d-25e5-4c0b-89ee-e77d51098fbe tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action" status: 200 len: 14 microversion: 2.1 time: 0.110371 Dec 15 16:22:04.930867 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 65/126] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:22:04 2021] POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:22:05.223307 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0d965c87-8c12-45aa-a69c-dd6a4f4d4fa3 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:05.224033 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-0d965c87-8c12-45aa-a69c-dd6a4f4d4fa3 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] [instance: f25d9543-b63f-4552-bf8c-633277eb0c58] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:05.231215 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0d965c87-8c12-45aa-a69c-dd6a4f4d4fa3 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:05.231699 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0d965c87-8c12-45aa-a69c-dd6a4f4d4fa3 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:05.232487 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0d965c87-8c12-45aa-a69c-dd6a4f4d4fa3 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:05.232917 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0d965c87-8c12-45aa-a69c-dd6a4f4d4fa3 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:05.235936 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-5af900ee-34ad-4138-a5c7-24f0d2eeb47a tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:05.236721 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-5af900ee-34ad-4138-a5c7-24f0d2eeb47a tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: bb8ad3f4-a466-4385-9311-93476fe7304e] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:05.245945 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5af900ee-34ad-4138-a5c7-24f0d2eeb47a tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:05.265033 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5af900ee-34ad-4138-a5c7-24f0d2eeb47a tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:05.267479 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5af900ee-34ad-4138-a5c7-24f0d2eeb47a tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:05.270777 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5af900ee-34ad-4138-a5c7-24f0d2eeb47a tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:05.449902 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-0d965c87-8c12-45aa-a69c-dd6a4f4d4fa3 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb9f7ee83454ee38fd6d0ef1db12c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c056527e8db4053b789853fcf928010', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:05.461447 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0d965c87-8c12-45aa-a69c-dd6a4f4d4fa3 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] 10.222.0.60 "GET /compute/v2.1/servers/f25d9543-b63f-4552-bf8c-633277eb0c58" status: 200 len: 1313 microversion: 2.1 time: 0.243138 Dec 15 16:22:05.463150 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 62/127] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:05 2021] GET /compute/v2.1/servers/f25d9543-b63f-4552-bf8c-633277eb0c58 => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:05.468204 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-82372d5c-a855-42df-a255-749668a19e91 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:05.469355 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-82372d5c-a855-42df-a255-749668a19e91 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] [instance: 619e9cc8-266e-47ae-a393-2140979be159] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:05.476489 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-82372d5c-a855-42df-a255-749668a19e91 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:05.476940 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-82372d5c-a855-42df-a255-749668a19e91 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:05.477776 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-82372d5c-a855-42df-a255-749668a19e91 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:05.478275 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-82372d5c-a855-42df-a255-749668a19e91 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:05.510207 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-5af900ee-34ad-4138-a5c7-24f0d2eeb47a tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:05.511184 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-82372d5c-a855-42df-a255-749668a19e91 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] [instance: 619e9cc8-266e-47ae-a393-2140979be159] Going to try to terminate instance {{(pid=116084) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:22:05.521565 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-5af900ee-34ad-4138-a5c7-24f0d2eeb47a tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e" status: 200 len: 1520 microversion: 2.1 time: 0.290928 Dec 15 16:22:05.522635 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 66/128] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:05 2021] GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e => generated 1520 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:05.622859 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-82372d5c-a855-42df-a255-749668a19e91 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] 10.222.0.60 "DELETE /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159" status: 204 len: 0 microversion: 2.1 time: 0.158056 Dec 15 16:22:05.623868 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 63/129] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Dec 15 16:22:05 2021] DELETE /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:22:05.636923 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-aa48f90a-f9ec-4bb3-a09c-1b0a973bcad5 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:05.640059 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-aa48f90a-f9ec-4bb3-a09c-1b0a973bcad5 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] [instance: 619e9cc8-266e-47ae-a393-2140979be159] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:05.648774 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-aa48f90a-f9ec-4bb3-a09c-1b0a973bcad5 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:05.649236 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-aa48f90a-f9ec-4bb3-a09c-1b0a973bcad5 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:05.650167 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-aa48f90a-f9ec-4bb3-a09c-1b0a973bcad5 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:05.650593 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-aa48f90a-f9ec-4bb3-a09c-1b0a973bcad5 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:05.856076 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-aa48f90a-f9ec-4bb3-a09c-1b0a973bcad5 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff15ede3a4f04e48bea87424ba6424ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaba77899e64379bebe94bb60ec1876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:05.873127 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-aa48f90a-f9ec-4bb3-a09c-1b0a973bcad5 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] 10.222.0.60 "GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159" status: 200 len: 1552 microversion: 2.1 time: 0.243224 Dec 15 16:22:05.873967 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 67/130] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:05 2021] GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159 => generated 1552 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:05.948103 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-466be6ff-8e23-4c47-8818-139faab0d9af tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:05.948838 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-466be6ff-8e23-4c47-8818-139faab0d9af tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:05.960465 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-466be6ff-8e23-4c47-8818-139faab0d9af tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:05.961850 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-466be6ff-8e23-4c47-8818-139faab0d9af tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:05.963273 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-466be6ff-8e23-4c47-8818-139faab0d9af tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:05.963850 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-466be6ff-8e23-4c47-8818-139faab0d9af tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:06.007668 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-03327821-823a-44d3-a940-d23b7700a8b2 req-6dc5d215-ff66-4c92-8c3a-cb26aa622548 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f25d9543-b63f-4552-bf8c-633277eb0c58", "name": "network-vif-plugged", "status": "completed", "tag": "c68e21af-42be-4707-8908-9b6e83c71a44"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:06.009894 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:22:06.009894 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Dec 15 16:22:06.028978 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-03327821-823a-44d3-a940-d23b7700a8b2 req-6dc5d215-ff66-4c92-8c3a-cb26aa622548 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:06.029424 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-03327821-823a-44d3-a940-d23b7700a8b2 req-6dc5d215-ff66-4c92-8c3a-cb26aa622548 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:06.041410 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-03327821-823a-44d3-a940-d23b7700a8b2 req-6dc5d215-ff66-4c92-8c3a-cb26aa622548 service nova] Creating event network-vif-plugged:c68e21af-42be-4707-8908-9b6e83c71a44 for instance f25d9543-b63f-4552-bf8c-633277eb0c58 on hv-cinder-81268 Dec 15 16:22:06.047178 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-03327821-823a-44d3-a940-d23b7700a8b2 req-6dc5d215-ff66-4c92-8c3a-cb26aa622548 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044446 Dec 15 16:22:06.048173 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 68/131] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:22:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:22:06.083270 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-466be6ff-8e23-4c47-8818-139faab0d9af tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action" status: 200 len: 14 microversion: 2.1 time: 0.144226 Dec 15 16:22:06.083963 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 64/132] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:22:05 2021] POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:22:06.481165 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-119c2658-728c-417a-aea8-78da27766131 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:06.481875 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-119c2658-728c-417a-aea8-78da27766131 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] [instance: f25d9543-b63f-4552-bf8c-633277eb0c58] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:06.489532 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-119c2658-728c-417a-aea8-78da27766131 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:06.490155 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-119c2658-728c-417a-aea8-78da27766131 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:06.491177 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-119c2658-728c-417a-aea8-78da27766131 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:06.491733 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-119c2658-728c-417a-aea8-78da27766131 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:06.541948 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ffad1595-bc20-48c6-a9eb-99bb0a96ddd3 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:06.542639 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ffad1595-bc20-48c6-a9eb-99bb0a96ddd3 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: bb8ad3f4-a466-4385-9311-93476fe7304e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:06.550484 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ffad1595-bc20-48c6-a9eb-99bb0a96ddd3 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:06.550931 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ffad1595-bc20-48c6-a9eb-99bb0a96ddd3 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:06.551744 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ffad1595-bc20-48c6-a9eb-99bb0a96ddd3 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:06.552173 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ffad1595-bc20-48c6-a9eb-99bb0a96ddd3 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:06.679058 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-119c2658-728c-417a-aea8-78da27766131 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb9f7ee83454ee38fd6d0ef1db12c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c056527e8db4053b789853fcf928010', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:06.687082 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-119c2658-728c-417a-aea8-78da27766131 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] 10.222.0.60 "GET /compute/v2.1/servers/f25d9543-b63f-4552-bf8c-633277eb0c58" status: 200 len: 1313 microversion: 2.1 time: 0.210438 Dec 15 16:22:06.687683 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 69/133] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:06 2021] GET /compute/v2.1/servers/f25d9543-b63f-4552-bf8c-633277eb0c58 => generated 1313 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:06.892856 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-be7f82d4-9404-4daa-9a85-08d2f1e5ff3e tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:06.894110 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-be7f82d4-9404-4daa-9a85-08d2f1e5ff3e tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] [instance: 619e9cc8-266e-47ae-a393-2140979be159] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:06.900465 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-be7f82d4-9404-4daa-9a85-08d2f1e5ff3e tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:06.901106 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-be7f82d4-9404-4daa-9a85-08d2f1e5ff3e tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:06.902072 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-be7f82d4-9404-4daa-9a85-08d2f1e5ff3e tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:06.903288 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-be7f82d4-9404-4daa-9a85-08d2f1e5ff3e tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:06.925272 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ffad1595-bc20-48c6-a9eb-99bb0a96ddd3 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:06.933698 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ffad1595-bc20-48c6-a9eb-99bb0a96ddd3 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e" status: 200 len: 1520 microversion: 2.1 time: 0.395788 Dec 15 16:22:06.934876 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 65/134] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:06 2021] GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e => generated 1520 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:22:07.055121 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-be7f82d4-9404-4daa-9a85-08d2f1e5ff3e tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff15ede3a4f04e48bea87424ba6424ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaba77899e64379bebe94bb60ec1876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:07.063563 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-be7f82d4-9404-4daa-9a85-08d2f1e5ff3e tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] 10.222.0.60 "GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159" status: 200 len: 1552 microversion: 2.1 time: 0.174855 Dec 15 16:22:07.064252 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 70/135] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:06 2021] GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159 => generated 1552 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:22:07.094845 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-9d9ab9ab-dddf-434b-ad40-52c22844d994 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:07.095825 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-9d9ab9ab-dddf-434b-ad40-52c22844d994 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:07.102946 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9d9ab9ab-dddf-434b-ad40-52c22844d994 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:07.103788 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9d9ab9ab-dddf-434b-ad40-52c22844d994 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:07.104593 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9d9ab9ab-dddf-434b-ad40-52c22844d994 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:07.105024 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9d9ab9ab-dddf-434b-ad40-52c22844d994 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:07.704542 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-d2797af8-31b5-4e0b-842f-844908d8787e tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:07.705133 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-d2797af8-31b5-4e0b-842f-844908d8787e tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] [instance: f25d9543-b63f-4552-bf8c-633277eb0c58] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:07.712159 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d2797af8-31b5-4e0b-842f-844908d8787e tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:07.712612 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d2797af8-31b5-4e0b-842f-844908d8787e tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:07.713403 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d2797af8-31b5-4e0b-842f-844908d8787e tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:07.713826 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d2797af8-31b5-4e0b-842f-844908d8787e tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:07.872909 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-d2797af8-31b5-4e0b-842f-844908d8787e tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb9f7ee83454ee38fd6d0ef1db12c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c056527e8db4053b789853fcf928010', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:07.880724 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-d2797af8-31b5-4e0b-842f-844908d8787e tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] 10.222.0.60 "GET /compute/v2.1/servers/f25d9543-b63f-4552-bf8c-633277eb0c58" status: 200 len: 1313 microversion: 2.1 time: 0.180014 Dec 15 16:22:07.881314 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 71/136] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:07 2021] GET /compute/v2.1/servers/f25d9543-b63f-4552-bf8c-633277eb0c58 => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:07.951821 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-bb86a3c9-75a9-4852-82af-4970cf46f178 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:07.952583 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-bb86a3c9-75a9-4852-82af-4970cf46f178 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: bb8ad3f4-a466-4385-9311-93476fe7304e] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:07.962210 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bb86a3c9-75a9-4852-82af-4970cf46f178 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:07.962606 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bb86a3c9-75a9-4852-82af-4970cf46f178 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:07.963445 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bb86a3c9-75a9-4852-82af-4970cf46f178 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:07.964110 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bb86a3c9-75a9-4852-82af-4970cf46f178 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:08.119918 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-bb86a3c9-75a9-4852-82af-4970cf46f178 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:08.128380 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-bb86a3c9-75a9-4852-82af-4970cf46f178 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e" status: 200 len: 1520 microversion: 2.1 time: 0.180467 Dec 15 16:22:08.129038 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 72/137] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:07 2021] GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:08.133758 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-1d0ce603-0a15-473e-83b2-7acf727b3832 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:08.134367 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-1d0ce603-0a15-473e-83b2-7acf727b3832 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] [instance: 619e9cc8-266e-47ae-a393-2140979be159] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:08.141347 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1d0ce603-0a15-473e-83b2-7acf727b3832 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:08.142173 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1d0ce603-0a15-473e-83b2-7acf727b3832 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:08.142877 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1d0ce603-0a15-473e-83b2-7acf727b3832 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:08.143319 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1d0ce603-0a15-473e-83b2-7acf727b3832 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:08.289111 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-1d0ce603-0a15-473e-83b2-7acf727b3832 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff15ede3a4f04e48bea87424ba6424ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaba77899e64379bebe94bb60ec1876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:08.297891 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-1d0ce603-0a15-473e-83b2-7acf727b3832 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] 10.222.0.60 "GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159" status: 200 len: 1552 microversion: 2.1 time: 0.167495 Dec 15 16:22:08.298503 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 73/138] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:08 2021] GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159 => generated 1552 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:08.899032 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-390de71e-a98b-444d-80db-1486ddc76161 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:08.899683 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-390de71e-a98b-444d-80db-1486ddc76161 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] [instance: f25d9543-b63f-4552-bf8c-633277eb0c58] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:08.908522 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-390de71e-a98b-444d-80db-1486ddc76161 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:08.909118 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-390de71e-a98b-444d-80db-1486ddc76161 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:08.910114 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-390de71e-a98b-444d-80db-1486ddc76161 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:08.910554 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-390de71e-a98b-444d-80db-1486ddc76161 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:09.072753 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-390de71e-a98b-444d-80db-1486ddc76161 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb9f7ee83454ee38fd6d0ef1db12c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c056527e8db4053b789853fcf928010', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:09.081666 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-390de71e-a98b-444d-80db-1486ddc76161 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] 10.222.0.60 "GET /compute/v2.1/servers/f25d9543-b63f-4552-bf8c-633277eb0c58" status: 200 len: 1313 microversion: 2.1 time: 0.186380 Dec 15 16:22:09.082585 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 74/139] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:08 2021] GET /compute/v2.1/servers/f25d9543-b63f-4552-bf8c-633277eb0c58 => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:09.146703 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-df4d6117-436a-4623-b6cf-7be273e10513 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:09.147306 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-df4d6117-436a-4623-b6cf-7be273e10513 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: bb8ad3f4-a466-4385-9311-93476fe7304e] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:09.153684 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-df4d6117-436a-4623-b6cf-7be273e10513 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:09.154060 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-df4d6117-436a-4623-b6cf-7be273e10513 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:09.154836 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-df4d6117-436a-4623-b6cf-7be273e10513 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:09.155257 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-df4d6117-436a-4623-b6cf-7be273e10513 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:09.309616 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-df4d6117-436a-4623-b6cf-7be273e10513 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:09.320361 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-df4d6117-436a-4623-b6cf-7be273e10513 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e" status: 200 len: 1520 microversion: 2.1 time: 0.177330 Dec 15 16:22:09.321079 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 75/140] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:09 2021] GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:09.325967 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-f18c2be8-a4b4-4ba3-8ef9-b58fa23f39c4 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:09.326832 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-f18c2be8-a4b4-4ba3-8ef9-b58fa23f39c4 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] [instance: 619e9cc8-266e-47ae-a393-2140979be159] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:09.334298 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f18c2be8-a4b4-4ba3-8ef9-b58fa23f39c4 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:09.334932 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f18c2be8-a4b4-4ba3-8ef9-b58fa23f39c4 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:09.335743 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f18c2be8-a4b4-4ba3-8ef9-b58fa23f39c4 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:09.336168 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f18c2be8-a4b4-4ba3-8ef9-b58fa23f39c4 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:09.486555 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-f18c2be8-a4b4-4ba3-8ef9-b58fa23f39c4 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff15ede3a4f04e48bea87424ba6424ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaba77899e64379bebe94bb60ec1876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:09.495774 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-f18c2be8-a4b4-4ba3-8ef9-b58fa23f39c4 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] 10.222.0.60 "GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159" status: 200 len: 1552 microversion: 2.1 time: 0.173284 Dec 15 16:22:09.496385 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 76/141] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:09 2021] GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159 => generated 1552 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:09.677607 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-9d9ab9ab-dddf-434b-ad40-52c22844d994 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action" status: 200 len: 14 microversion: 2.1 time: 2.587091 Dec 15 16:22:09.678196 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 66/142] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:22:07 2021] POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action => generated 14 bytes in 2589 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:22:10.100629 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-e6adef05-3950-433a-af1d-9ccfcd5f987c tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:10.101298 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-e6adef05-3950-433a-af1d-9ccfcd5f987c tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] [instance: f25d9543-b63f-4552-bf8c-633277eb0c58] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:10.108587 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e6adef05-3950-433a-af1d-9ccfcd5f987c tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:10.109046 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e6adef05-3950-433a-af1d-9ccfcd5f987c tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:10.109847 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e6adef05-3950-433a-af1d-9ccfcd5f987c tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:10.110417 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e6adef05-3950-433a-af1d-9ccfcd5f987c tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:10.320998 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-e6adef05-3950-433a-af1d-9ccfcd5f987c tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb9f7ee83454ee38fd6d0ef1db12c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c056527e8db4053b789853fcf928010', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:10.337854 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-e6adef05-3950-433a-af1d-9ccfcd5f987c tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] 10.222.0.60 "GET /compute/v2.1/servers/f25d9543-b63f-4552-bf8c-633277eb0c58" status: 200 len: 1313 microversion: 2.1 time: 0.241150 Dec 15 16:22:10.338782 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 77/143] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:10 2021] GET /compute/v2.1/servers/f25d9543-b63f-4552-bf8c-633277eb0c58 => generated 1313 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:10.345305 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-3a36a258-6f69-4009-8a1d-b8ac7bd09c38 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:10.346099 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-3a36a258-6f69-4009-8a1d-b8ac7bd09c38 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: bb8ad3f4-a466-4385-9311-93476fe7304e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:10.355249 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3a36a258-6f69-4009-8a1d-b8ac7bd09c38 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:10.355917 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3a36a258-6f69-4009-8a1d-b8ac7bd09c38 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:10.357683 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3a36a258-6f69-4009-8a1d-b8ac7bd09c38 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:10.358313 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3a36a258-6f69-4009-8a1d-b8ac7bd09c38 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:10.519312 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-bbfd3da4-448f-4dce-82ff-782acdc18b4a tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:10.520512 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-bbfd3da4-448f-4dce-82ff-782acdc18b4a tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] [instance: 619e9cc8-266e-47ae-a393-2140979be159] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:10.529410 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bbfd3da4-448f-4dce-82ff-782acdc18b4a tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:10.532635 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bbfd3da4-448f-4dce-82ff-782acdc18b4a tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:10.532635 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bbfd3da4-448f-4dce-82ff-782acdc18b4a tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:10.532635 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bbfd3da4-448f-4dce-82ff-782acdc18b4a tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:10.683970 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-3a36a258-6f69-4009-8a1d-b8ac7bd09c38 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:10.695631 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-3a36a258-6f69-4009-8a1d-b8ac7bd09c38 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e" status: 200 len: 1520 microversion: 2.1 time: 0.354462 Dec 15 16:22:10.704428 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 67/144] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:10 2021] GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e => generated 1520 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:10.711546 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-13adef40-024a-4b63-a1cb-9fa3043eb30b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:10.713008 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-13adef40-024a-4b63-a1cb-9fa3043eb30b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:10.720943 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-13adef40-024a-4b63-a1cb-9fa3043eb30b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:10.721583 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-13adef40-024a-4b63-a1cb-9fa3043eb30b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:10.722432 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-13adef40-024a-4b63-a1cb-9fa3043eb30b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:10.723039 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-13adef40-024a-4b63-a1cb-9fa3043eb30b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:10.794528 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-bbfd3da4-448f-4dce-82ff-782acdc18b4a tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff15ede3a4f04e48bea87424ba6424ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaba77899e64379bebe94bb60ec1876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:10.806884 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-bbfd3da4-448f-4dce-82ff-782acdc18b4a tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] 10.222.0.60 "GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159" status: 200 len: 1552 microversion: 2.1 time: 0.295088 Dec 15 16:22:10.807928 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 78/145] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:10 2021] GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159 => generated 1552 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:22:10.843274 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-13adef40-024a-4b63-a1cb-9fa3043eb30b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action" status: 200 len: 14 microversion: 2.1 time: 0.136700 Dec 15 16:22:10.844346 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 68/146] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:22:10 2021] POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action => generated 14 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:22:11.366491 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-6e011acc-c8fd-4891-aba0-728eaf244ef3 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:11.367685 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-6e011acc-c8fd-4891-aba0-728eaf244ef3 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] [instance: f25d9543-b63f-4552-bf8c-633277eb0c58] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:11.374577 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6e011acc-c8fd-4891-aba0-728eaf244ef3 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:11.375031 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6e011acc-c8fd-4891-aba0-728eaf244ef3 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:11.376203 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6e011acc-c8fd-4891-aba0-728eaf244ef3 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:11.376833 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6e011acc-c8fd-4891-aba0-728eaf244ef3 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:11.556725 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-6e011acc-c8fd-4891-aba0-728eaf244ef3 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb9f7ee83454ee38fd6d0ef1db12c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c056527e8db4053b789853fcf928010', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:11.567426 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-6e011acc-c8fd-4891-aba0-728eaf244ef3 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] 10.222.0.60 "GET /compute/v2.1/servers/f25d9543-b63f-4552-bf8c-633277eb0c58" status: 200 len: 1497 microversion: 2.1 time: 0.204538 Dec 15 16:22:11.568263 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 79/147] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:11 2021] GET /compute/v2.1/servers/f25d9543-b63f-4552-bf8c-633277eb0c58 => generated 1497 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:11.726432 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1fe3e4dc-0c1c-4207-b462-c15f95f6ac79 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:11.727174 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1fe3e4dc-0c1c-4207-b462-c15f95f6ac79 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: bb8ad3f4-a466-4385-9311-93476fe7304e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:11.737072 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1fe3e4dc-0c1c-4207-b462-c15f95f6ac79 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:11.737530 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1fe3e4dc-0c1c-4207-b462-c15f95f6ac79 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:11.738341 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1fe3e4dc-0c1c-4207-b462-c15f95f6ac79 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:11.738904 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1fe3e4dc-0c1c-4207-b462-c15f95f6ac79 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:11.834464 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-38f7d8fc-9317-46f1-a795-d6c06dfe1c73 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:11.836606 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-38f7d8fc-9317-46f1-a795-d6c06dfe1c73 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] [instance: 619e9cc8-266e-47ae-a393-2140979be159] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:11.850330 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-38f7d8fc-9317-46f1-a795-d6c06dfe1c73 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:11.851410 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-38f7d8fc-9317-46f1-a795-d6c06dfe1c73 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:11.852753 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-38f7d8fc-9317-46f1-a795-d6c06dfe1c73 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:11.854108 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-38f7d8fc-9317-46f1-a795-d6c06dfe1c73 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:11.940489 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1fe3e4dc-0c1c-4207-b462-c15f95f6ac79 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:11.960190 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1fe3e4dc-0c1c-4207-b462-c15f95f6ac79 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e" status: 200 len: 1520 microversion: 2.1 time: 0.239945 Dec 15 16:22:11.962138 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 69/148] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:11 2021] GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e => generated 1520 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:22:11.976242 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-2153c0ec-ce65-45b2-991d-cb879f9a2ef4 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:11.977726 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-2153c0ec-ce65-45b2-991d-cb879f9a2ef4 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:11.991286 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2153c0ec-ce65-45b2-991d-cb879f9a2ef4 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:11.993191 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2153c0ec-ce65-45b2-991d-cb879f9a2ef4 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:11.994604 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2153c0ec-ce65-45b2-991d-cb879f9a2ef4 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:11.995869 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2153c0ec-ce65-45b2-991d-cb879f9a2ef4 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:12.132323 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-2153c0ec-ce65-45b2-991d-cb879f9a2ef4 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action" status: 200 len: 14 microversion: 2.1 time: 0.166991 Dec 15 16:22:12.132999 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 70/149] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:22:11 2021] POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action => generated 14 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:22:12.160414 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-38f7d8fc-9317-46f1-a795-d6c06dfe1c73 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff15ede3a4f04e48bea87424ba6424ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaba77899e64379bebe94bb60ec1876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:12.181670 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-38f7d8fc-9317-46f1-a795-d6c06dfe1c73 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] 10.222.0.60 "GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159" status: 200 len: 1552 microversion: 2.1 time: 0.357660 Dec 15 16:22:12.182725 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 80/150] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:11 2021] GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159 => generated 1552 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:22:12.565655 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-af15f8a3-b20f-44aa-8c6d-56056610ec38 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1688073564", "imageRef": "b72b5f54-34d0-48ac-9484-bc8104a6dddb", "flavorRef": "452", "networks": [{"uuid": "d3a23e9e-8c1c-4ad2-af72-ef7451820760"}]}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:12.643692 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.network.neutron [None req-af15f8a3-b20f-44aa-8c6d-56056610ec38 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] validate_networks() for [('d3a23e9e-8c1c-4ad2-af72-ef7451820760', None, None, None, None, None)] {{(pid=116084) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:22:12.996389 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-cee4452f-a9d1-4c29-9cb8-c5fd8d1da1d6 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:12.997477 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-cee4452f-a9d1-4c29-9cb8-c5fd8d1da1d6 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: bb8ad3f4-a466-4385-9311-93476fe7304e] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:13.010299 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-cee4452f-a9d1-4c29-9cb8-c5fd8d1da1d6 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:13.011444 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-cee4452f-a9d1-4c29-9cb8-c5fd8d1da1d6 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:13.013202 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-cee4452f-a9d1-4c29-9cb8-c5fd8d1da1d6 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:13.015130 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-cee4452f-a9d1-4c29-9cb8-c5fd8d1da1d6 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:13.163425 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-af15f8a3-b20f-44aa-8c6d-56056610ec38 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Flavor limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:22:13.164258 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-af15f8a3-b20f-44aa-8c6d-56056610ec38 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Image limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:22:13.164752 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-af15f8a3-b20f-44aa-8c6d-56056610ec38 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Flavor pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:22:13.165260 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-af15f8a3-b20f-44aa-8c6d-56056610ec38 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Image pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:22:13.165813 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-af15f8a3-b20f-44aa-8c6d-56056610ec38 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:22:13.183153 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-af15f8a3-b20f-44aa-8c6d-56056610ec38 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:13.184972 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-af15f8a3-b20f-44aa-8c6d-56056610ec38 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:13.186538 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-af15f8a3-b20f-44aa-8c6d-56056610ec38 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:13.187291 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-af15f8a3-b20f-44aa-8c6d-56056610ec38 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:13.217020 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-af15f8a3-b20f-44aa-8c6d-56056610ec38 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Getting quotas for project 6cccb6b08dc94f04a5efa2624d350007. Resources: {'cores', 'instances', 'ram'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:22:13.222451 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-cee4452f-a9d1-4c29-9cb8-c5fd8d1da1d6 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:13.224729 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-af15f8a3-b20f-44aa-8c6d-56056610ec38 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Getting quotas for user 27c81feca86e49f193efb42a81a6c3c1 and project 6cccb6b08dc94f04a5efa2624d350007. Resources: {'cores', 'instances', 'ram'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:22:13.236495 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-cee4452f-a9d1-4c29-9cb8-c5fd8d1da1d6 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e" status: 200 len: 1520 microversion: 2.1 time: 0.245753 Dec 15 16:22:13.237124 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 81/151] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:12 2021] GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e => generated 1520 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:13.241799 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-e61168b2-8243-4dcc-be94-5580ec82878b req-a14eb048-b2f4-4859-b0a4-ce4848ab1199 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "619e9cc8-266e-47ae-a393-2140979be159", "name": "network-vif-deleted", "tag": "bdc0e4f8-fd70-4efb-be09-06ef2ca1e701"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:13.243468 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:22:13.243468 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Dec 15 16:22:13.246369 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-af15f8a3-b20f-44aa-8c6d-56056610ec38 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Going to run 1 instances... {{(pid=116084) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:22:13.250308 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-af15f8a3-b20f-44aa-8c6d-56056610ec38 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: e2e4e9fd-273e-4f05-811f-d997caf4636c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b72b5f54-34d0-48ac-9484-bc8104a6dddb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116084) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:22:13.251536 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-e61168b2-8243-4dcc-be94-5580ec82878b req-a14eb048-b2f4-4859-b0a4-ce4848ab1199 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:13.251983 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-e61168b2-8243-4dcc-be94-5580ec82878b req-a14eb048-b2f4-4859-b0a4-ce4848ab1199 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:13.264149 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-e61168b2-8243-4dcc-be94-5580ec82878b req-a14eb048-b2f4-4859-b0a4-ce4848ab1199 service nova] Creating event network-vif-deleted:bdc0e4f8-fd70-4efb-be09-06ef2ca1e701 for instance 619e9cc8-266e-47ae-a393-2140979be159 on hv-cinder-81268 Dec 15 16:22:13.269994 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-e61168b2-8243-4dcc-be94-5580ec82878b req-a14eb048-b2f4-4859-b0a4-ce4848ab1199 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031580 Dec 15 16:22:13.270706 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 82/152] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:22:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:22:13.276067 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-3e6a51ab-81db-47a3-9df7-a90ba242cec1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:13.277202 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-3e6a51ab-81db-47a3-9df7-a90ba242cec1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:13.284875 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3e6a51ab-81db-47a3-9df7-a90ba242cec1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:13.285320 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3e6a51ab-81db-47a3-9df7-a90ba242cec1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:13.286343 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3e6a51ab-81db-47a3-9df7-a90ba242cec1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:13.286789 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3e6a51ab-81db-47a3-9df7-a90ba242cec1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:13.328229 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-af15f8a3-b20f-44aa-8c6d-56056610ec38 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.767343 Dec 15 16:22:13.330468 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 71/153] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Dec 15 16:22:12 2021] POST /compute/v2.1/servers => generated 380 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 16:22:13.335585 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0d46c9a0-139a-488b-916c-14e1f3399f64 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:13.336685 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-0d46c9a0-139a-488b-916c-14e1f3399f64 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] [instance: 619e9cc8-266e-47ae-a393-2140979be159] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:13.345774 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0d46c9a0-139a-488b-916c-14e1f3399f64 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:13.346767 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0d46c9a0-139a-488b-916c-14e1f3399f64 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:13.347874 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0d46c9a0-139a-488b-916c-14e1f3399f64 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:13.348552 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0d46c9a0-139a-488b-916c-14e1f3399f64 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:13.425248 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-0d46c9a0-139a-488b-916c-14e1f3399f64 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff15ede3a4f04e48bea87424ba6424ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaba77899e64379bebe94bb60ec1876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:13.434201 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0d46c9a0-139a-488b-916c-14e1f3399f64 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] 10.222.0.60 "GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159" status: 200 len: 1510 microversion: 2.1 time: 0.102184 Dec 15 16:22:13.434821 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 72/154] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:13 2021] GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159 => generated 1510 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:13.440335 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-25c9d773-d9d3-4526-b0ff-02345348c695 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:13.440959 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-25c9d773-d9d3-4526-b0ff-02345348c695 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: e2e4e9fd-273e-4f05-811f-d997caf4636c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:13.498495 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-25c9d773-d9d3-4526-b0ff-02345348c695 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:13.510057 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-25c9d773-d9d3-4526-b0ff-02345348c695 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/e2e4e9fd-273e-4f05-811f-d997caf4636c" status: 200 len: 1218 microversion: 2.1 time: 0.073545 Dec 15 16:22:13.511091 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 73/155] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:13 2021] GET /compute/v2.1/servers/e2e4e9fd-273e-4f05-811f-d997caf4636c => generated 1218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:14.259488 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-80ede97a-8163-4f0b-b23b-2577ebf4aadb tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:14.260549 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-80ede97a-8163-4f0b-b23b-2577ebf4aadb tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: bb8ad3f4-a466-4385-9311-93476fe7304e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:14.270225 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-80ede97a-8163-4f0b-b23b-2577ebf4aadb tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:14.270671 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-80ede97a-8163-4f0b-b23b-2577ebf4aadb tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:14.271524 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-80ede97a-8163-4f0b-b23b-2577ebf4aadb tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:14.271999 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-80ede97a-8163-4f0b-b23b-2577ebf4aadb tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:14.432230 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-80ede97a-8163-4f0b-b23b-2577ebf4aadb tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:14.446396 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-80ede97a-8163-4f0b-b23b-2577ebf4aadb tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e" status: 200 len: 1520 microversion: 2.1 time: 0.191857 Dec 15 16:22:14.447468 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 74/156] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:14 2021] GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:22:14.457612 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-00a6fe59-25d9-4233-857b-6fdcd9854629 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:14.458783 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-00a6fe59-25d9-4233-857b-6fdcd9854629 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] [instance: 619e9cc8-266e-47ae-a393-2140979be159] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:14.467166 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-00a6fe59-25d9-4233-857b-6fdcd9854629 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:14.467736 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-00a6fe59-25d9-4233-857b-6fdcd9854629 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:14.468592 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-00a6fe59-25d9-4233-857b-6fdcd9854629 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:14.469042 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-00a6fe59-25d9-4233-857b-6fdcd9854629 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:14.542718 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-00a6fe59-25d9-4233-857b-6fdcd9854629 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff15ede3a4f04e48bea87424ba6424ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaba77899e64379bebe94bb60ec1876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:14.554050 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-00a6fe59-25d9-4233-857b-6fdcd9854629 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] 10.222.0.60 "GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159" status: 200 len: 1345 microversion: 2.1 time: 0.103823 Dec 15 16:22:14.554647 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 75/157] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:14 2021] GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159 => generated 1345 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:14.559261 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-236b2a6a-83ef-4a4f-a4be-495be9c6b7eb tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:14.559897 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-236b2a6a-83ef-4a4f-a4be-495be9c6b7eb tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: e2e4e9fd-273e-4f05-811f-d997caf4636c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:14.567738 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-236b2a6a-83ef-4a4f-a4be-495be9c6b7eb tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:14.568243 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-236b2a6a-83ef-4a4f-a4be-495be9c6b7eb tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:14.569094 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-236b2a6a-83ef-4a4f-a4be-495be9c6b7eb tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:14.569568 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-236b2a6a-83ef-4a4f-a4be-495be9c6b7eb tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:14.652337 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-236b2a6a-83ef-4a4f-a4be-495be9c6b7eb tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:14.661297 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-236b2a6a-83ef-4a4f-a4be-495be9c6b7eb tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/e2e4e9fd-273e-4f05-811f-d997caf4636c" status: 200 len: 1222 microversion: 2.1 time: 0.105475 Dec 15 16:22:14.661846 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 76/158] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:14 2021] GET /compute/v2.1/servers/e2e4e9fd-273e-4f05-811f-d997caf4636c => generated 1222 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:15.423017 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-3e6a51ab-81db-47a3-9df7-a90ba242cec1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action" status: 200 len: 14 microversion: 2.1 time: 2.150745 Dec 15 16:22:15.424532 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 83/159] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:22:13 2021] POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action => generated 14 bytes in 2153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:22:15.473016 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ab77d3d7-f8cd-48dc-909a-efb8c0f98f78 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:15.474339 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ab77d3d7-f8cd-48dc-909a-efb8c0f98f78 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: bb8ad3f4-a466-4385-9311-93476fe7304e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:15.483572 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ab77d3d7-f8cd-48dc-909a-efb8c0f98f78 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:15.484106 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ab77d3d7-f8cd-48dc-909a-efb8c0f98f78 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:15.485299 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ab77d3d7-f8cd-48dc-909a-efb8c0f98f78 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:15.485508 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ab77d3d7-f8cd-48dc-909a-efb8c0f98f78 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:15.574686 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-6fe9d18d-6b50-4561-ae81-73024d7eb39c tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:15.575452 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-6fe9d18d-6b50-4561-ae81-73024d7eb39c tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] [instance: 619e9cc8-266e-47ae-a393-2140979be159] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:15.585137 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6fe9d18d-6b50-4561-ae81-73024d7eb39c tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:15.586157 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6fe9d18d-6b50-4561-ae81-73024d7eb39c tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:15.587113 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6fe9d18d-6b50-4561-ae81-73024d7eb39c tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:15.587676 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6fe9d18d-6b50-4561-ae81-73024d7eb39c tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:15.706438 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-6fe9d18d-6b50-4561-ae81-73024d7eb39c tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff15ede3a4f04e48bea87424ba6424ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaba77899e64379bebe94bb60ec1876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:15.715300 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ab77d3d7-f8cd-48dc-909a-efb8c0f98f78 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:15.716601 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-6fe9d18d-6b50-4561-ae81-73024d7eb39c tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] 10.222.0.60 "GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159" status: 200 len: 1345 microversion: 2.1 time: 0.147422 Dec 15 16:22:15.717544 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 84/160] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:15 2021] GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159 => generated 1345 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:22:15.722878 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-6d1717b2-7972-4a4c-8e94-e664429c2a06 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:15.723486 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-6d1717b2-7972-4a4c-8e94-e664429c2a06 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: e2e4e9fd-273e-4f05-811f-d997caf4636c] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:15.734799 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6d1717b2-7972-4a4c-8e94-e664429c2a06 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:15.736213 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6d1717b2-7972-4a4c-8e94-e664429c2a06 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:15.737555 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6d1717b2-7972-4a4c-8e94-e664429c2a06 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:15.738374 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ab77d3d7-f8cd-48dc-909a-efb8c0f98f78 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e" status: 200 len: 1520 microversion: 2.1 time: 0.270577 Dec 15 16:22:15.738900 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6d1717b2-7972-4a4c-8e94-e664429c2a06 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:15.740010 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 77/161] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:15 2021] GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e => generated 1520 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:22:15.834045 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-6d1717b2-7972-4a4c-8e94-e664429c2a06 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:15.842035 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-6d1717b2-7972-4a4c-8e94-e664429c2a06 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/e2e4e9fd-273e-4f05-811f-d997caf4636c" status: 200 len: 1270 microversion: 2.1 time: 0.123261 Dec 15 16:22:15.842636 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 85/162] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:15 2021] GET /compute/v2.1/servers/e2e4e9fd-273e-4f05-811f-d997caf4636c => generated 1270 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:15.900097 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-30d23cfb-7bd8-4d65-bb15-984c59cda376 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:15.900581 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-30d23cfb-7bd8-4d65-bb15-984c59cda376 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] [instance: f25d9543-b63f-4552-bf8c-633277eb0c58] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:15.907824 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-30d23cfb-7bd8-4d65-bb15-984c59cda376 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:15.908292 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-30d23cfb-7bd8-4d65-bb15-984c59cda376 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:15.909113 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-30d23cfb-7bd8-4d65-bb15-984c59cda376 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:15.909541 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-30d23cfb-7bd8-4d65-bb15-984c59cda376 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:15.941941 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-30d23cfb-7bd8-4d65-bb15-984c59cda376 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] [instance: f25d9543-b63f-4552-bf8c-633277eb0c58] Going to try to terminate instance {{(pid=116084) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:22:16.066577 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-30d23cfb-7bd8-4d65-bb15-984c59cda376 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f25d9543-b63f-4552-bf8c-633277eb0c58" status: 204 len: 0 microversion: 2.1 time: 0.169304 Dec 15 16:22:16.067018 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 78/163] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Dec 15 16:22:15 2021] DELETE /compute/v2.1/servers/f25d9543-b63f-4552-bf8c-633277eb0c58 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:22:16.091822 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-57d7340c-0359-4092-bd6f-06cc9a7f1d8c tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:16.092624 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-57d7340c-0359-4092-bd6f-06cc9a7f1d8c tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] [instance: f25d9543-b63f-4552-bf8c-633277eb0c58] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:16.101860 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-57d7340c-0359-4092-bd6f-06cc9a7f1d8c tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:16.102306 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-57d7340c-0359-4092-bd6f-06cc9a7f1d8c tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:16.103749 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-57d7340c-0359-4092-bd6f-06cc9a7f1d8c tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:16.104212 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-57d7340c-0359-4092-bd6f-06cc9a7f1d8c tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:16.377940 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-57d7340c-0359-4092-bd6f-06cc9a7f1d8c tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb9f7ee83454ee38fd6d0ef1db12c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c056527e8db4053b789853fcf928010', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:16.395204 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-57d7340c-0359-4092-bd6f-06cc9a7f1d8c tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] 10.222.0.60 "GET /compute/v2.1/servers/f25d9543-b63f-4552-bf8c-633277eb0c58" status: 200 len: 1503 microversion: 2.1 time: 0.320806 Dec 15 16:22:16.396402 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 86/164] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:16 2021] GET /compute/v2.1/servers/f25d9543-b63f-4552-bf8c-633277eb0c58 => generated 1503 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:16.441671 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0accb245-75f7-4bdf-b506-293e44df75b1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:16.445246 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-0accb245-75f7-4bdf-b506-293e44df75b1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:16.457265 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0accb245-75f7-4bdf-b506-293e44df75b1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:16.458051 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0accb245-75f7-4bdf-b506-293e44df75b1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:16.459510 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0accb245-75f7-4bdf-b506-293e44df75b1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:16.460392 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0accb245-75f7-4bdf-b506-293e44df75b1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:16.585937 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0accb245-75f7-4bdf-b506-293e44df75b1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action" status: 200 len: 14 microversion: 2.1 time: 0.145279 Dec 15 16:22:16.587023 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 79/165] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:22:16 2021] POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action => generated 14 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:22:16.748828 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-16a86886-3f28-4ec3-83f5-6e4fc777123b tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:16.752297 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-16a86886-3f28-4ec3-83f5-6e4fc777123b tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] [instance: 619e9cc8-266e-47ae-a393-2140979be159] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:16.758653 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-16a86886-3f28-4ec3-83f5-6e4fc777123b tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:16.759160 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-16a86886-3f28-4ec3-83f5-6e4fc777123b tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:16.760025 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-16a86886-3f28-4ec3-83f5-6e4fc777123b tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:16.760452 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-16a86886-3f28-4ec3-83f5-6e4fc777123b tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:16.761661 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ec721ed2-59f6-467d-a05d-72cd873d63bd tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:16.762893 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ec721ed2-59f6-467d-a05d-72cd873d63bd tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: bb8ad3f4-a466-4385-9311-93476fe7304e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:16.778722 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ec721ed2-59f6-467d-a05d-72cd873d63bd tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:16.779709 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ec721ed2-59f6-467d-a05d-72cd873d63bd tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:16.780958 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ec721ed2-59f6-467d-a05d-72cd873d63bd tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:16.781629 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ec721ed2-59f6-467d-a05d-72cd873d63bd tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:17.000535 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-16a86886-3f28-4ec3-83f5-6e4fc777123b tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:17.002226 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-16a86886-3f28-4ec3-83f5-6e4fc777123b tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:17.003152 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.objects.instance [None req-16a86886-3f28-4ec3-83f5-6e4fc777123b tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lazy-loading 'fault' on Instance uuid 619e9cc8-266e-47ae-a393-2140979be159 {{(pid=116085) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:22:17.106234 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-16a86886-3f28-4ec3-83f5-6e4fc777123b tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff15ede3a4f04e48bea87424ba6424ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaba77899e64379bebe94bb60ec1876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:17.123540 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-16a86886-3f28-4ec3-83f5-6e4fc777123b tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] 10.222.0.60 "GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159" status: 200 len: 1304 microversion: 2.1 time: 0.378177 Dec 15 16:22:17.124587 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 87/166] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:16 2021] GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159 => generated 1304 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:22:17.134176 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-f48c5d79-ed63-4919-a018-6f0827a812e3 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:17.135616 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-f48c5d79-ed63-4919-a018-6f0827a812e3 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: e2e4e9fd-273e-4f05-811f-d997caf4636c] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:17.147601 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ec721ed2-59f6-467d-a05d-72cd873d63bd tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:17.155775 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f48c5d79-ed63-4919-a018-6f0827a812e3 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:17.156222 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f48c5d79-ed63-4919-a018-6f0827a812e3 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:17.158153 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f48c5d79-ed63-4919-a018-6f0827a812e3 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:17.158810 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f48c5d79-ed63-4919-a018-6f0827a812e3 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:17.166550 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ec721ed2-59f6-467d-a05d-72cd873d63bd tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e" status: 200 len: 1520 microversion: 2.1 time: 0.410391 Dec 15 16:22:17.170786 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 80/167] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:16 2021] GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e => generated 1520 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:17.304147 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-f48c5d79-ed63-4919-a018-6f0827a812e3 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:17.348512 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-f48c5d79-ed63-4919-a018-6f0827a812e3 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/e2e4e9fd-273e-4f05-811f-d997caf4636c" status: 200 len: 1276 microversion: 2.1 time: 0.214492 Dec 15 16:22:17.365292 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 88/168] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:17 2021] GET /compute/v2.1/servers/e2e4e9fd-273e-4f05-811f-d997caf4636c => generated 1276 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:17.417905 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-9d02f16c-7015-4220-8fe1-fb04d4a5d054 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:17.418235 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-9d02f16c-7015-4220-8fe1-fb04d4a5d054 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] [instance: f25d9543-b63f-4552-bf8c-633277eb0c58] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:17.431257 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9d02f16c-7015-4220-8fe1-fb04d4a5d054 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:17.433938 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9d02f16c-7015-4220-8fe1-fb04d4a5d054 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:17.436482 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9d02f16c-7015-4220-8fe1-fb04d4a5d054 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:17.443435 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9d02f16c-7015-4220-8fe1-fb04d4a5d054 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:17.600290 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-2fbe1798-c3e9-418a-a83f-03ce4fc3da62 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:17.601914 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-2fbe1798-c3e9-418a-a83f-03ce4fc3da62 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:17.618528 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2fbe1798-c3e9-418a-a83f-03ce4fc3da62 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:17.627242 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2fbe1798-c3e9-418a-a83f-03ce4fc3da62 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:17.628355 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2fbe1798-c3e9-418a-a83f-03ce4fc3da62 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:17.633381 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2fbe1798-c3e9-418a-a83f-03ce4fc3da62 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:17.739211 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-9d02f16c-7015-4220-8fe1-fb04d4a5d054 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb9f7ee83454ee38fd6d0ef1db12c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c056527e8db4053b789853fcf928010', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:17.751840 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-9d02f16c-7015-4220-8fe1-fb04d4a5d054 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] 10.222.0.60 "GET /compute/v2.1/servers/f25d9543-b63f-4552-bf8c-633277eb0c58" status: 200 len: 1503 microversion: 2.1 time: 0.340909 Dec 15 16:22:17.761869 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-2fbe1798-c3e9-418a-a83f-03ce4fc3da62 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action" status: 200 len: 14 microversion: 2.1 time: 0.156992 Dec 15 16:22:17.761869 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 89/169] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:22:17 2021] POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action => generated 14 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:22:17.763996 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 81/170] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:17 2021] GET /compute/v2.1/servers/f25d9543-b63f-4552-bf8c-633277eb0c58 => generated 1503 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:18.155951 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-ddb4c076-6427-45cb-8b39-e9ee4057dc16 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:18.157700 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-ddb4c076-6427-45cb-8b39-e9ee4057dc16 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] [instance: 619e9cc8-266e-47ae-a393-2140979be159] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:18.173817 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ddb4c076-6427-45cb-8b39-e9ee4057dc16 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:18.174945 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ddb4c076-6427-45cb-8b39-e9ee4057dc16 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:18.176702 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ddb4c076-6427-45cb-8b39-e9ee4057dc16 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:18.177694 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ddb4c076-6427-45cb-8b39-e9ee4057dc16 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:18.191432 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0beef28a-4739-46cd-8cb9-78cca1f25af5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:18.192083 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-0beef28a-4739-46cd-8cb9-78cca1f25af5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: bb8ad3f4-a466-4385-9311-93476fe7304e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:18.206207 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0beef28a-4739-46cd-8cb9-78cca1f25af5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:18.206960 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0beef28a-4739-46cd-8cb9-78cca1f25af5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:18.207989 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0beef28a-4739-46cd-8cb9-78cca1f25af5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:18.208581 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0beef28a-4739-46cd-8cb9-78cca1f25af5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:18.220545 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.wsgi [None req-ddb4c076-6427-45cb-8b39-e9ee4057dc16 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] HTTP exception thrown: Instance 619e9cc8-266e-47ae-a393-2140979be159 could not be found. Dec 15 16:22:18.221718 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-ddb4c076-6427-45cb-8b39-e9ee4057dc16 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Returning 404 to user: Instance 619e9cc8-266e-47ae-a393-2140979be159 could not be found. {{(pid=116085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:22:18.223642 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-ddb4c076-6427-45cb-8b39-e9ee4057dc16 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] 10.222.0.60 "GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159" status: 404 len: 111 microversion: 2.1 time: 0.074838 Dec 15 16:22:18.225415 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 90/171] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:18 2021] GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:22:18.382670 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-b0e81c08-116e-41f3-b784-b65b37797277 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:18.383971 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-b0e81c08-116e-41f3-b784-b65b37797277 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: e2e4e9fd-273e-4f05-811f-d997caf4636c] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:18.398082 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b0e81c08-116e-41f3-b784-b65b37797277 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:18.399004 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b0e81c08-116e-41f3-b784-b65b37797277 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:18.400436 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b0e81c08-116e-41f3-b784-b65b37797277 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:18.401011 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b0e81c08-116e-41f3-b784-b65b37797277 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:18.781272 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-0beef28a-4739-46cd-8cb9-78cca1f25af5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:18.796339 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0beef28a-4739-46cd-8cb9-78cca1f25af5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e" status: 200 len: 1520 microversion: 2.1 time: 0.610454 Dec 15 16:22:18.798523 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 82/172] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:18 2021] GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e => generated 1520 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:18.806944 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-79a7e0fd-15f0-4d3d-a0fb-4c9864e0b62b tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:18.808914 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-79a7e0fd-15f0-4d3d-a0fb-4c9864e0b62b tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] [instance: 619e9cc8-266e-47ae-a393-2140979be159] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:18.827776 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-79a7e0fd-15f0-4d3d-a0fb-4c9864e0b62b tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:18.828477 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-79a7e0fd-15f0-4d3d-a0fb-4c9864e0b62b tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:18.830655 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-79a7e0fd-15f0-4d3d-a0fb-4c9864e0b62b tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:18.832245 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-79a7e0fd-15f0-4d3d-a0fb-4c9864e0b62b tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:18.894902 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-79a7e0fd-15f0-4d3d-a0fb-4c9864e0b62b tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] HTTP exception thrown: Instance 619e9cc8-266e-47ae-a393-2140979be159 could not be found. Dec 15 16:22:18.896456 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-79a7e0fd-15f0-4d3d-a0fb-4c9864e0b62b tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Returning 404 to user: Instance 619e9cc8-266e-47ae-a393-2140979be159 could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:22:18.901775 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-79a7e0fd-15f0-4d3d-a0fb-4c9864e0b62b tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] 10.222.0.60 "GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.100312 Dec 15 16:22:18.903545 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 83/173] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Dec 15 16:22:18 2021] GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159/os-volume_attachments => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:22:18.919393 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-783b3a09-9eb7-41a7-a436-b0697e4530c5 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:18.925155 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-783b3a09-9eb7-41a7-a436-b0697e4530c5 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:18.939356 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-783b3a09-9eb7-41a7-a436-b0697e4530c5 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:18.940520 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-783b3a09-9eb7-41a7-a436-b0697e4530c5 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:18.943529 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-783b3a09-9eb7-41a7-a436-b0697e4530c5 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:18.944561 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-783b3a09-9eb7-41a7-a436-b0697e4530c5 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:18.954616 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-b0e81c08-116e-41f3-b784-b65b37797277 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:19.008859 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-b0e81c08-116e-41f3-b784-b65b37797277 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/e2e4e9fd-273e-4f05-811f-d997caf4636c" status: 200 len: 1318 microversion: 2.1 time: 0.630003 Dec 15 16:22:19.013470 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 91/174] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:18 2021] GET /compute/v2.1/servers/e2e4e9fd-273e-4f05-811f-d997caf4636c => generated 1318 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:22:19.033550 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-ddead45d-481d-437e-bdb6-9c5ea1104aca tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:19.034627 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-ddead45d-481d-437e-bdb6-9c5ea1104aca tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] [instance: f25d9543-b63f-4552-bf8c-633277eb0c58] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:19.068283 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ddead45d-481d-437e-bdb6-9c5ea1104aca tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:19.069161 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ddead45d-481d-437e-bdb6-9c5ea1104aca tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:19.076723 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ddead45d-481d-437e-bdb6-9c5ea1104aca tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:19.077440 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ddead45d-481d-437e-bdb6-9c5ea1104aca tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:19.080797 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-783b3a09-9eb7-41a7-a436-b0697e4530c5 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action" status: 200 len: 6451 microversion: 2.1 time: 0.174329 Dec 15 16:22:19.083075 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 84/175] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:22:18 2021] POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action => generated 6451 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:19.521325 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-ddead45d-481d-437e-bdb6-9c5ea1104aca tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb9f7ee83454ee38fd6d0ef1db12c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c056527e8db4053b789853fcf928010', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:19.545565 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-ddead45d-481d-437e-bdb6-9c5ea1104aca tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] 10.222.0.60 "GET /compute/v2.1/servers/f25d9543-b63f-4552-bf8c-633277eb0c58" status: 200 len: 1503 microversion: 2.1 time: 0.520920 Dec 15 16:22:19.546367 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 92/176] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:19 2021] GET /compute/v2.1/servers/f25d9543-b63f-4552-bf8c-633277eb0c58 => generated 1503 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:19.608173 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-1cc2e603-5913-4a78-9a98-153eb8da22fa req-af2f88fd-a5f7-4c4e-9a2c-7b24b6d040cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2e4e9fd-273e-4f05-811f-d997caf4636c", "tag": "1351aeaa-4e2c-4d63-aadd-c4160a439008"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:19.616932 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:22:19.616932 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:22:19.648556 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-1cc2e603-5913-4a78-9a98-153eb8da22fa req-af2f88fd-a5f7-4c4e-9a2c-7b24b6d040cd service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:19.656165 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-1cc2e603-5913-4a78-9a98-153eb8da22fa req-af2f88fd-a5f7-4c4e-9a2c-7b24b6d040cd service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:19.690573 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-1cc2e603-5913-4a78-9a98-153eb8da22fa req-af2f88fd-a5f7-4c4e-9a2c-7b24b6d040cd service nova] Creating event network-changed:1351aeaa-4e2c-4d63-aadd-c4160a439008 for instance e2e4e9fd-273e-4f05-811f-d997caf4636c on hv-cinder-81268 Dec 15 16:22:19.699771 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-1cc2e603-5913-4a78-9a98-153eb8da22fa req-af2f88fd-a5f7-4c4e-9a2c-7b24b6d040cd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111684 Dec 15 16:22:19.700954 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 85/177] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:22:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:22:19.826982 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-8753c069-7dd4-4bc2-afe6-b07dc63dbcfa tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:19.828396 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-8753c069-7dd4-4bc2-afe6-b07dc63dbcfa tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: bb8ad3f4-a466-4385-9311-93476fe7304e] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:19.836490 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8753c069-7dd4-4bc2-afe6-b07dc63dbcfa tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:19.837286 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8753c069-7dd4-4bc2-afe6-b07dc63dbcfa tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:19.838575 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8753c069-7dd4-4bc2-afe6-b07dc63dbcfa tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:19.839221 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8753c069-7dd4-4bc2-afe6-b07dc63dbcfa tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:20.037792 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ca09cf30-5b21-4149-bfc4-874e68c2d2fe tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:20.038509 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ca09cf30-5b21-4149-bfc4-874e68c2d2fe tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: e2e4e9fd-273e-4f05-811f-d997caf4636c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:20.055111 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ca09cf30-5b21-4149-bfc4-874e68c2d2fe tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:20.055803 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ca09cf30-5b21-4149-bfc4-874e68c2d2fe tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:20.057419 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ca09cf30-5b21-4149-bfc4-874e68c2d2fe tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:20.058377 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ca09cf30-5b21-4149-bfc4-874e68c2d2fe tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:20.135314 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-8753c069-7dd4-4bc2-afe6-b07dc63dbcfa tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:20.144657 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-8753c069-7dd4-4bc2-afe6-b07dc63dbcfa tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e" status: 200 len: 1520 microversion: 2.1 time: 0.323573 Dec 15 16:22:20.146216 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 93/178] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:19 2021] GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e => generated 1520 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:20.155816 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-fdd627ed-9813-47f5-8f2d-1d0958443350 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:20.157296 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-fdd627ed-9813-47f5-8f2d-1d0958443350 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:20.169297 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fdd627ed-9813-47f5-8f2d-1d0958443350 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:20.170240 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fdd627ed-9813-47f5-8f2d-1d0958443350 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:20.171765 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fdd627ed-9813-47f5-8f2d-1d0958443350 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:20.173085 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fdd627ed-9813-47f5-8f2d-1d0958443350 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:20.309667 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-fdd627ed-9813-47f5-8f2d-1d0958443350 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action" status: 200 len: 11723 microversion: 2.1 time: 0.161386 Dec 15 16:22:20.310905 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 94/179] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:22:20 2021] POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action => generated 11723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:22:20.361952 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-1dddd4bb-3fd4-4f6b-9399-716bc412d925 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:20.363130 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-1dddd4bb-3fd4-4f6b-9399-716bc412d925 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] [instance: 619e9cc8-266e-47ae-a393-2140979be159] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:20.371584 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1dddd4bb-3fd4-4f6b-9399-716bc412d925 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:20.372053 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1dddd4bb-3fd4-4f6b-9399-716bc412d925 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:20.373064 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1dddd4bb-3fd4-4f6b-9399-716bc412d925 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:20.373506 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1dddd4bb-3fd4-4f6b-9399-716bc412d925 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:20.391143 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.wsgi [None req-1dddd4bb-3fd4-4f6b-9399-716bc412d925 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] HTTP exception thrown: Instance 619e9cc8-266e-47ae-a393-2140979be159 could not be found. Dec 15 16:22:20.391777 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-1dddd4bb-3fd4-4f6b-9399-716bc412d925 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Returning 404 to user: Instance 619e9cc8-266e-47ae-a393-2140979be159 could not be found. {{(pid=116085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:22:20.392634 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-1dddd4bb-3fd4-4f6b-9399-716bc412d925 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] 10.222.0.60 "DELETE /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159" status: 404 len: 111 microversion: 2.1 time: 0.037421 Dec 15 16:22:20.393370 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 95/180] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Dec 15 16:22:20 2021] DELETE /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 16:22:20.394777 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ca09cf30-5b21-4149-bfc4-874e68c2d2fe tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:20.403437 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-7bd1c591-942a-4345-9f4a-20d3941b0463 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:20.404159 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-7bd1c591-942a-4345-9f4a-20d3941b0463 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] [instance: 619e9cc8-266e-47ae-a393-2140979be159] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:20.411315 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7bd1c591-942a-4345-9f4a-20d3941b0463 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:20.412366 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7bd1c591-942a-4345-9f4a-20d3941b0463 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:20.413534 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7bd1c591-942a-4345-9f4a-20d3941b0463 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:20.414043 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7bd1c591-942a-4345-9f4a-20d3941b0463 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:20.419050 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ca09cf30-5b21-4149-bfc4-874e68c2d2fe tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/e2e4e9fd-273e-4f05-811f-d997caf4636c" status: 200 len: 1318 microversion: 2.1 time: 0.386490 Dec 15 16:22:20.420037 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 86/181] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:20 2021] GET /compute/v2.1/servers/e2e4e9fd-273e-4f05-811f-d997caf4636c => generated 1318 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:20.436459 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.wsgi [None req-7bd1c591-942a-4345-9f4a-20d3941b0463 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] HTTP exception thrown: Instance 619e9cc8-266e-47ae-a393-2140979be159 could not be found. Dec 15 16:22:20.437061 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-7bd1c591-942a-4345-9f4a-20d3941b0463 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] Returning 404 to user: Instance 619e9cc8-266e-47ae-a393-2140979be159 could not be found. {{(pid=116085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:22:20.438012 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-7bd1c591-942a-4345-9f4a-20d3941b0463 tempest-DeleteServersTestJSON-1545335616 tempest-DeleteServersTestJSON-1545335616-project] 10.222.0.60 "GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159" status: 404 len: 111 microversion: 2.1 time: 0.040056 Dec 15 16:22:20.438872 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 96/182] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:20 2021] GET /compute/v2.1/servers/619e9cc8-266e-47ae-a393-2140979be159 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:22:20.565420 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1ab9500b-8703-4bee-8340-0d4efb0937dd tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:20.566484 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1ab9500b-8703-4bee-8340-0d4efb0937dd tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] [instance: f25d9543-b63f-4552-bf8c-633277eb0c58] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:20.573867 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1ab9500b-8703-4bee-8340-0d4efb0937dd tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:20.574687 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1ab9500b-8703-4bee-8340-0d4efb0937dd tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:20.576321 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1ab9500b-8703-4bee-8340-0d4efb0937dd tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:20.576705 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1ab9500b-8703-4bee-8340-0d4efb0937dd tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:20.616207 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1ab9500b-8703-4bee-8340-0d4efb0937dd tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:20.617060 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1ab9500b-8703-4bee-8340-0d4efb0937dd tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:20.617976 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.objects.instance [None req-1ab9500b-8703-4bee-8340-0d4efb0937dd tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lazy-loading 'fault' on Instance uuid f25d9543-b63f-4552-bf8c-633277eb0c58 {{(pid=116084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:22:20.718238 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1ab9500b-8703-4bee-8340-0d4efb0937dd tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb9f7ee83454ee38fd6d0ef1db12c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c056527e8db4053b789853fcf928010', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:20.728743 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1ab9500b-8703-4bee-8340-0d4efb0937dd tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] 10.222.0.60 "GET /compute/v2.1/servers/f25d9543-b63f-4552-bf8c-633277eb0c58" status: 200 len: 1303 microversion: 2.1 time: 0.167692 Dec 15 16:22:20.741101 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 87/183] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:20 2021] GET /compute/v2.1/servers/f25d9543-b63f-4552-bf8c-633277eb0c58 => generated 1303 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:21.175629 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-8f383b71-a246-43de-b276-2c0a455a2db1 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:21.176954 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-8f383b71-a246-43de-b276-2c0a455a2db1 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: bb8ad3f4-a466-4385-9311-93476fe7304e] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:21.184574 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8f383b71-a246-43de-b276-2c0a455a2db1 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:21.185462 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8f383b71-a246-43de-b276-2c0a455a2db1 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:21.186412 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8f383b71-a246-43de-b276-2c0a455a2db1 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:21.186845 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8f383b71-a246-43de-b276-2c0a455a2db1 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:21.325964 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-578fcb73-9155-49eb-815a-c008890d2698 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:21.327245 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-578fcb73-9155-49eb-815a-c008890d2698 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:21.334807 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-578fcb73-9155-49eb-815a-c008890d2698 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:21.335247 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-578fcb73-9155-49eb-815a-c008890d2698 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:21.336458 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-578fcb73-9155-49eb-815a-c008890d2698 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:21.345950 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-578fcb73-9155-49eb-815a-c008890d2698 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:21.488448 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-8f383b71-a246-43de-b276-2c0a455a2db1 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:21.501309 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-8f383b71-a246-43de-b276-2c0a455a2db1 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e" status: 200 len: 1520 microversion: 2.1 time: 0.329464 Dec 15 16:22:21.502824 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 97/184] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:21 2021] GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e => generated 1520 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:22:21.519205 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-08a9046b-c722-4f0c-af26-6b3e955268ca tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:21.519662 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-578fcb73-9155-49eb-815a-c008890d2698 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action" status: 200 len: 15465 microversion: 2.1 time: 0.197401 Dec 15 16:22:21.521235 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-08a9046b-c722-4f0c-af26-6b3e955268ca tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: e2e4e9fd-273e-4f05-811f-d997caf4636c] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:21.526237 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 88/185] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:22:21 2021] POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action => generated 15465 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:22:21.536017 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-08a9046b-c722-4f0c-af26-6b3e955268ca tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:21.537207 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-08a9046b-c722-4f0c-af26-6b3e955268ca tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:21.538981 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-08a9046b-c722-4f0c-af26-6b3e955268ca tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:21.542015 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-08a9046b-c722-4f0c-af26-6b3e955268ca tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:21.729724 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-9ac04c46-dc83-4cdd-b4a2-936295ae6740 req-e47f80ed-7833-4abb-a298-8f468b489d41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f25d9543-b63f-4552-bf8c-633277eb0c58", "name": "network-vif-deleted", "tag": "c68e21af-42be-4707-8908-9b6e83c71a44"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:21.732192 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:22:21.732192 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:22:21.747511 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-9ac04c46-dc83-4cdd-b4a2-936295ae6740 req-e47f80ed-7833-4abb-a298-8f468b489d41 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:21.748216 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-9ac04c46-dc83-4cdd-b4a2-936295ae6740 req-e47f80ed-7833-4abb-a298-8f468b489d41 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:21.768238 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-9ac04c46-dc83-4cdd-b4a2-936295ae6740 req-e47f80ed-7833-4abb-a298-8f468b489d41 service nova] Creating event network-vif-deleted:c68e21af-42be-4707-8908-9b6e83c71a44 for instance f25d9543-b63f-4552-bf8c-633277eb0c58 on hv-cinder-81268 Dec 15 16:22:21.777017 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-9ac04c46-dc83-4cdd-b4a2-936295ae6740 req-e47f80ed-7833-4abb-a298-8f468b489d41 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054121 Dec 15 16:22:21.778406 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 89/186] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:22:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:22:21.789348 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-9b70a31d-b9b7-4069-ae8a-e21546bdfa56 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:21.790444 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-9b70a31d-b9b7-4069-ae8a-e21546bdfa56 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] [instance: f25d9543-b63f-4552-bf8c-633277eb0c58] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:21.804442 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9b70a31d-b9b7-4069-ae8a-e21546bdfa56 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:21.805870 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9b70a31d-b9b7-4069-ae8a-e21546bdfa56 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:21.808072 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9b70a31d-b9b7-4069-ae8a-e21546bdfa56 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:21.809068 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9b70a31d-b9b7-4069-ae8a-e21546bdfa56 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:21.835216 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-9b70a31d-b9b7-4069-ae8a-e21546bdfa56 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] HTTP exception thrown: Instance f25d9543-b63f-4552-bf8c-633277eb0c58 could not be found. Dec 15 16:22:21.837317 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-9b70a31d-b9b7-4069-ae8a-e21546bdfa56 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Returning 404 to user: Instance f25d9543-b63f-4552-bf8c-633277eb0c58 could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:22:21.839328 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-9b70a31d-b9b7-4069-ae8a-e21546bdfa56 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] 10.222.0.60 "GET /compute/v2.1/servers/f25d9543-b63f-4552-bf8c-633277eb0c58" status: 404 len: 111 microversion: 2.1 time: 0.058472 Dec 15 16:22:21.840534 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 90/187] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:21 2021] GET /compute/v2.1/servers/f25d9543-b63f-4552-bf8c-633277eb0c58 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:22:21.878844 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-08a9046b-c722-4f0c-af26-6b3e955268ca tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:21.890594 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-08a9046b-c722-4f0c-af26-6b3e955268ca tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/e2e4e9fd-273e-4f05-811f-d997caf4636c" status: 200 len: 1318 microversion: 2.1 time: 0.385911 Dec 15 16:22:21.892593 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 98/188] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:21 2021] GET /compute/v2.1/servers/e2e4e9fd-273e-4f05-811f-d997caf4636c => generated 1318 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:22.054310 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-15ba0fbb-5a66-4b06-bac0-74ff079a611b tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-494607077", "imageRef": "b72b5f54-34d0-48ac-9484-bc8104a6dddb", "flavorRef": "452", "networks": [{"uuid": "719c9634-9007-4e20-b3e0-eba40acf400f"}]}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:22.162265 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.network.neutron [None req-15ba0fbb-5a66-4b06-bac0-74ff079a611b tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] validate_networks() for [('719c9634-9007-4e20-b3e0-eba40acf400f', None, None, None, None, None)] {{(pid=116084) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:22:22.520949 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-87ee35d3-ba35-44ad-9b26-d5bd987af747 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:22.521487 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-87ee35d3-ba35-44ad-9b26-d5bd987af747 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: bb8ad3f4-a466-4385-9311-93476fe7304e] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:22.532847 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-87ee35d3-ba35-44ad-9b26-d5bd987af747 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:22.534352 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-87ee35d3-ba35-44ad-9b26-d5bd987af747 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:22.536266 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-87ee35d3-ba35-44ad-9b26-d5bd987af747 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:22.536997 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-87ee35d3-ba35-44ad-9b26-d5bd987af747 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:23.027915 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-87ee35d3-ba35-44ad-9b26-d5bd987af747 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:23.057944 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-87ee35d3-ba35-44ad-9b26-d5bd987af747 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e" status: 200 len: 1520 microversion: 2.1 time: 0.541072 Dec 15 16:22:23.067303 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 99/189] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:22 2021] GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e => generated 1520 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:23.086864 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-d6072509-0c7b-47df-8467-0396a644eda8 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:23.089397 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-15ba0fbb-5a66-4b06-bac0-74ff079a611b tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Flavor limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:22:23.090090 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-d6072509-0c7b-47df-8467-0396a644eda8 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:23.090910 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-15ba0fbb-5a66-4b06-bac0-74ff079a611b tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Image limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:22:23.092828 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-15ba0fbb-5a66-4b06-bac0-74ff079a611b tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Flavor pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:22:23.093577 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-15ba0fbb-5a66-4b06-bac0-74ff079a611b tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Image pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:22:23.094481 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-15ba0fbb-5a66-4b06-bac0-74ff079a611b tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:22:23.106918 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d6072509-0c7b-47df-8467-0396a644eda8 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:23.115184 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d6072509-0c7b-47df-8467-0396a644eda8 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:23.121117 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d6072509-0c7b-47df-8467-0396a644eda8 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:23.122099 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d6072509-0c7b-47df-8467-0396a644eda8 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:23.124503 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-15ba0fbb-5a66-4b06-bac0-74ff079a611b tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:23.124953 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-15ba0fbb-5a66-4b06-bac0-74ff079a611b tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:23.128719 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-15ba0fbb-5a66-4b06-bac0-74ff079a611b tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:23.130593 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-15ba0fbb-5a66-4b06-bac0-74ff079a611b tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:23.161781 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-15ba0fbb-5a66-4b06-bac0-74ff079a611b tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Getting quotas for project 6c056527e8db4053b789853fcf928010. Resources: {'cores', 'instances', 'ram'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:22:23.170848 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-15ba0fbb-5a66-4b06-bac0-74ff079a611b tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Getting quotas for user 3bb9f7ee83454ee38fd6d0ef1db12c18 and project 6c056527e8db4053b789853fcf928010. Resources: {'cores', 'instances', 'ram'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:22:23.192939 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-15ba0fbb-5a66-4b06-bac0-74ff079a611b tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Going to run 1 instances... {{(pid=116084) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:22:23.199967 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-15ba0fbb-5a66-4b06-bac0-74ff079a611b tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] [instance: 96617b99-e916-4aa8-a3f5-3ef4ed329f04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b72b5f54-34d0-48ac-9484-bc8104a6dddb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116084) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:22:23.271084 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-15ba0fbb-5a66-4b06-bac0-74ff079a611b tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.224465 Dec 15 16:22:23.278314 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 91/190] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Dec 15 16:22:22 2021] POST /compute/v2.1/servers => generated 380 bytes in 1229 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 15 16:22:23.292184 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-5b20b60b-fd91-4e28-b09a-baa78f0ce718 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:23.292925 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-5b20b60b-fd91-4e28-b09a-baa78f0ce718 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: e2e4e9fd-273e-4f05-811f-d997caf4636c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:23.299399 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-d6072509-0c7b-47df-8467-0396a644eda8 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action" status: 200 len: 17602 microversion: 2.1 time: 0.229141 Dec 15 16:22:23.304295 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5b20b60b-fd91-4e28-b09a-baa78f0ce718 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:23.304969 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5b20b60b-fd91-4e28-b09a-baa78f0ce718 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:23.306012 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5b20b60b-fd91-4e28-b09a-baa78f0ce718 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:23.306880 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5b20b60b-fd91-4e28-b09a-baa78f0ce718 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:23.307770 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 100/191] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:22:23 2021] POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action => generated 17602 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:22:23.335119 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-cb68aa6d-48ff-43b0-b6c9-728afa05826c tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:23.355010 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-cb68aa6d-48ff-43b0-b6c9-728afa05826c tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] [instance: 96617b99-e916-4aa8-a3f5-3ef4ed329f04] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:23.501081 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-cb68aa6d-48ff-43b0-b6c9-728afa05826c tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb9f7ee83454ee38fd6d0ef1db12c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c056527e8db4053b789853fcf928010', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:23.509915 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-cb68aa6d-48ff-43b0-b6c9-728afa05826c tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] 10.222.0.60 "GET /compute/v2.1/servers/96617b99-e916-4aa8-a3f5-3ef4ed329f04" status: 200 len: 1213 microversion: 2.1 time: 0.200232 Dec 15 16:22:23.513049 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 101/192] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:23 2021] GET /compute/v2.1/servers/96617b99-e916-4aa8-a3f5-3ef4ed329f04 => generated 1213 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:23.716713 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-5b20b60b-fd91-4e28-b09a-baa78f0ce718 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:23.731242 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-5b20b60b-fd91-4e28-b09a-baa78f0ce718 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/e2e4e9fd-273e-4f05-811f-d997caf4636c" status: 200 len: 1318 microversion: 2.1 time: 0.456114 Dec 15 16:22:23.732226 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 92/193] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:23 2021] GET /compute/v2.1/servers/e2e4e9fd-273e-4f05-811f-d997caf4636c => generated 1318 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:24.099418 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-1c7a5314-43c1-4f44-9f77-71e16b464651 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:24.099418 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-1c7a5314-43c1-4f44-9f77-71e16b464651 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: bb8ad3f4-a466-4385-9311-93476fe7304e] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:24.138282 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1c7a5314-43c1-4f44-9f77-71e16b464651 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:24.139054 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1c7a5314-43c1-4f44-9f77-71e16b464651 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:24.157231 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1c7a5314-43c1-4f44-9f77-71e16b464651 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:24.158158 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1c7a5314-43c1-4f44-9f77-71e16b464651 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:24.321258 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0b1a3669-e1ff-44f6-9433-c9711e3853d2 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:24.329532 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-0b1a3669-e1ff-44f6-9433-c9711e3853d2 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:24.362048 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0b1a3669-e1ff-44f6-9433-c9711e3853d2 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:24.368520 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0b1a3669-e1ff-44f6-9433-c9711e3853d2 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:24.374069 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0b1a3669-e1ff-44f6-9433-c9711e3853d2 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:24.374861 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0b1a3669-e1ff-44f6-9433-c9711e3853d2 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:24.551586 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0b1a3669-e1ff-44f6-9433-c9711e3853d2 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action" status: 200 len: 20562 microversion: 2.1 time: 0.241019 Dec 15 16:22:24.555408 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 93/194] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:22:24 2021] POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action => generated 20562 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:22:24.565485 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c18e0ad8-4b57-4887-a46b-c1254c9dc8c4 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:24.567301 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c18e0ad8-4b57-4887-a46b-c1254c9dc8c4 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] [instance: 96617b99-e916-4aa8-a3f5-3ef4ed329f04] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:24.590885 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c18e0ad8-4b57-4887-a46b-c1254c9dc8c4 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:24.595487 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c18e0ad8-4b57-4887-a46b-c1254c9dc8c4 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:24.597091 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c18e0ad8-4b57-4887-a46b-c1254c9dc8c4 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:24.597873 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c18e0ad8-4b57-4887-a46b-c1254c9dc8c4 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:24.674147 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-1c7a5314-43c1-4f44-9f77-71e16b464651 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:24.688344 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-1c7a5314-43c1-4f44-9f77-71e16b464651 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e" status: 200 len: 1520 microversion: 2.1 time: 0.604443 Dec 15 16:22:24.689670 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 102/195] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:24 2021] GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e => generated 1520 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:24.749518 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-3a54726b-189a-4c73-a3e9-944270ebb1aa tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:24.750676 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-3a54726b-189a-4c73-a3e9-944270ebb1aa tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: e2e4e9fd-273e-4f05-811f-d997caf4636c] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:24.766412 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3a54726b-189a-4c73-a3e9-944270ebb1aa tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:24.767305 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3a54726b-189a-4c73-a3e9-944270ebb1aa tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:24.771401 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3a54726b-189a-4c73-a3e9-944270ebb1aa tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:24.772136 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-c18e0ad8-4b57-4887-a46b-c1254c9dc8c4 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb9f7ee83454ee38fd6d0ef1db12c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c056527e8db4053b789853fcf928010', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:24.774654 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3a54726b-189a-4c73-a3e9-944270ebb1aa tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:24.788805 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c18e0ad8-4b57-4887-a46b-c1254c9dc8c4 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] 10.222.0.60 "GET /compute/v2.1/servers/96617b99-e916-4aa8-a3f5-3ef4ed329f04" status: 200 len: 1265 microversion: 2.1 time: 0.234241 Dec 15 16:22:24.790239 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 94/196] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:24 2021] GET /compute/v2.1/servers/96617b99-e916-4aa8-a3f5-3ef4ed329f04 => generated 1265 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:25.024757 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-3a54726b-189a-4c73-a3e9-944270ebb1aa tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:25.042498 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-3a54726b-189a-4c73-a3e9-944270ebb1aa tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/e2e4e9fd-273e-4f05-811f-d997caf4636c" status: 200 len: 1318 microversion: 2.1 time: 0.296290 Dec 15 16:22:25.044162 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 103/197] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:24 2021] GET /compute/v2.1/servers/e2e4e9fd-273e-4f05-811f-d997caf4636c => generated 1318 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:22:25.565319 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0a7f0756-2145-4a4a-b5d2-c5dd164aceff tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:25.567349 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-0a7f0756-2145-4a4a-b5d2-c5dd164aceff tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:25.578963 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0a7f0756-2145-4a4a-b5d2-c5dd164aceff tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:25.579797 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0a7f0756-2145-4a4a-b5d2-c5dd164aceff tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:25.581473 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0a7f0756-2145-4a4a-b5d2-c5dd164aceff tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:25.582173 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0a7f0756-2145-4a4a-b5d2-c5dd164aceff tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:25.706557 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0a7f0756-2145-4a4a-b5d2-c5dd164aceff tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action" status: 200 len: 22211 microversion: 2.1 time: 0.146526 Dec 15 16:22:25.707560 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 95/198] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:22:25 2021] POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action => generated 22211 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:22:25.720194 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-d2d6a88c-a1fe-4786-92e5-fcec51fd5b9a tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:25.721592 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-d2d6a88c-a1fe-4786-92e5-fcec51fd5b9a tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: bb8ad3f4-a466-4385-9311-93476fe7304e] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:25.744138 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d2d6a88c-a1fe-4786-92e5-fcec51fd5b9a tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:25.745188 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d2d6a88c-a1fe-4786-92e5-fcec51fd5b9a tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:25.746655 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d2d6a88c-a1fe-4786-92e5-fcec51fd5b9a tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:25.747695 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d2d6a88c-a1fe-4786-92e5-fcec51fd5b9a tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:25.812324 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-3bc76e63-2319-4f1f-860d-9acdecfd4a6f tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:25.813904 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-3bc76e63-2319-4f1f-860d-9acdecfd4a6f tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] [instance: 96617b99-e916-4aa8-a3f5-3ef4ed329f04] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:25.838100 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3bc76e63-2319-4f1f-860d-9acdecfd4a6f tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:25.838906 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3bc76e63-2319-4f1f-860d-9acdecfd4a6f tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:25.840806 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3bc76e63-2319-4f1f-860d-9acdecfd4a6f tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:25.841111 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3bc76e63-2319-4f1f-860d-9acdecfd4a6f tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:26.089441 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-3bc76e63-2319-4f1f-860d-9acdecfd4a6f tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb9f7ee83454ee38fd6d0ef1db12c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c056527e8db4053b789853fcf928010', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:26.109510 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-3bc76e63-2319-4f1f-860d-9acdecfd4a6f tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] 10.222.0.60 "GET /compute/v2.1/servers/96617b99-e916-4aa8-a3f5-3ef4ed329f04" status: 200 len: 1271 microversion: 2.1 time: 0.301977 Dec 15 16:22:26.111679 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 96/199] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:25 2021] GET /compute/v2.1/servers/96617b99-e916-4aa8-a3f5-3ef4ed329f04 => generated 1271 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:26.124378 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-9ddc3769-efb5-4e5b-b1ee-85758b6ec99f req-cf25efce-a837-4fc7-bfa0-dd81f7570f07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2e4e9fd-273e-4f05-811f-d997caf4636c", "name": "network-vif-plugged", "status": "completed", "tag": "1351aeaa-4e2c-4d63-aadd-c4160a439008"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:26.131589 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:22:26.131589 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:22:26.150357 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-9ddc3769-efb5-4e5b-b1ee-85758b6ec99f req-cf25efce-a837-4fc7-bfa0-dd81f7570f07 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:26.150894 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-9ddc3769-efb5-4e5b-b1ee-85758b6ec99f req-cf25efce-a837-4fc7-bfa0-dd81f7570f07 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:26.196707 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-9ddc3769-efb5-4e5b-b1ee-85758b6ec99f req-cf25efce-a837-4fc7-bfa0-dd81f7570f07 service nova] Creating event network-vif-plugged:1351aeaa-4e2c-4d63-aadd-c4160a439008 for instance e2e4e9fd-273e-4f05-811f-d997caf4636c on hv-cinder-81268 Dec 15 16:22:26.214324 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-9ddc3769-efb5-4e5b-b1ee-85758b6ec99f req-cf25efce-a837-4fc7-bfa0-dd81f7570f07 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095114 Dec 15 16:22:26.214993 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 97/200] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:22:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:22:26.234206 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-3ab40d28-55ae-456a-a963-8d361b819d3b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:26.237321 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-3ab40d28-55ae-456a-a963-8d361b819d3b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: e2e4e9fd-273e-4f05-811f-d997caf4636c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:26.268975 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-d2d6a88c-a1fe-4786-92e5-fcec51fd5b9a tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:26.279580 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3ab40d28-55ae-456a-a963-8d361b819d3b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:26.283649 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3ab40d28-55ae-456a-a963-8d361b819d3b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:26.289291 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3ab40d28-55ae-456a-a963-8d361b819d3b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:26.290026 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3ab40d28-55ae-456a-a963-8d361b819d3b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:26.295735 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-d2d6a88c-a1fe-4786-92e5-fcec51fd5b9a tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e" status: 200 len: 1520 microversion: 2.1 time: 0.579504 Dec 15 16:22:26.297777 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 104/201] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:25 2021] GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e => generated 1520 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:26.633217 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-3ab40d28-55ae-456a-a963-8d361b819d3b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:26.644640 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-3ab40d28-55ae-456a-a963-8d361b819d3b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/e2e4e9fd-273e-4f05-811f-d997caf4636c" status: 200 len: 1318 microversion: 2.1 time: 0.425851 Dec 15 16:22:26.645688 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 98/202] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:26 2021] GET /compute/v2.1/servers/e2e4e9fd-273e-4f05-811f-d997caf4636c => generated 1318 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:26.719299 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-cc468197-034b-47df-8b2a-267acc99eda1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:26.720816 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-cc468197-034b-47df-8b2a-267acc99eda1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:26.729098 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cc468197-034b-47df-8b2a-267acc99eda1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:26.729527 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cc468197-034b-47df-8b2a-267acc99eda1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:26.733370 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cc468197-034b-47df-8b2a-267acc99eda1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:26.733798 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cc468197-034b-47df-8b2a-267acc99eda1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:26.847769 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-36af0a07-ec91-4e42-8888-25bafa7b2a33 tempest-VolumesGetTestJSON-781643080 tempest-VolumesGetTestJSON-781643080-project] Action: 'create', calling method: .version_select at 0x7f0b26cf5820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-358107496", "metadata": {"Type": "work"}}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:26.975167 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-cc468197-034b-47df-8b2a-267acc99eda1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action" status: 200 len: 23798 microversion: 2.1 time: 0.260414 Dec 15 16:22:26.976541 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 99/203] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:22:26 2021] POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action => generated 23798 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:22:27.147460 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-7baae012-1583-488f-98d7-3ab08ba44464 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:27.149300 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-7baae012-1583-488f-98d7-3ab08ba44464 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] [instance: 96617b99-e916-4aa8-a3f5-3ef4ed329f04] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:27.168963 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7baae012-1583-488f-98d7-3ab08ba44464 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:27.171703 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7baae012-1583-488f-98d7-3ab08ba44464 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:27.174993 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7baae012-1583-488f-98d7-3ab08ba44464 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:27.176265 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7baae012-1583-488f-98d7-3ab08ba44464 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:27.563447 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-36af0a07-ec91-4e42-8888-25bafa7b2a33 tempest-VolumesGetTestJSON-781643080 tempest-VolumesGetTestJSON-781643080-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.264313 Dec 15 16:22:27.576098 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 105/204] 10.222.0.60 () {60 vars in 1155 bytes} [Wed Dec 15 16:22:26 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 1277 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 15 16:22:27.610911 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-2b21453c-f5ba-4013-bdd5-08f4421b4b3f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:27.613058 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-2b21453c-f5ba-4013-bdd5-08f4421b4b3f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: bb8ad3f4-a466-4385-9311-93476fe7304e] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:27.637723 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2b21453c-f5ba-4013-bdd5-08f4421b4b3f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:27.638893 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2b21453c-f5ba-4013-bdd5-08f4421b4b3f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:27.641395 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2b21453c-f5ba-4013-bdd5-08f4421b4b3f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:27.644578 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2b21453c-f5ba-4013-bdd5-08f4421b4b3f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:27.740767 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-7baae012-1583-488f-98d7-3ab08ba44464 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb9f7ee83454ee38fd6d0ef1db12c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c056527e8db4053b789853fcf928010', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:27.776497 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-7baae012-1583-488f-98d7-3ab08ba44464 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] 10.222.0.60 "GET /compute/v2.1/servers/96617b99-e916-4aa8-a3f5-3ef4ed329f04" status: 200 len: 1313 microversion: 2.1 time: 0.638757 Dec 15 16:22:27.782047 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 100/205] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:27 2021] GET /compute/v2.1/servers/96617b99-e916-4aa8-a3f5-3ef4ed329f04 => generated 1313 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:27.816087 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-a398e114-319b-4f4e-91ea-598a8d910de0 tempest-VolumesGetTestJSON-781643080 tempest-VolumesGetTestJSON-781643080-project] Calling method '.version_select at 0x7f0b27538af0>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:28.088986 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-2b21453c-f5ba-4013-bdd5-08f4421b4b3f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:28.133898 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-2b21453c-f5ba-4013-bdd5-08f4421b4b3f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e" status: 200 len: 1520 microversion: 2.1 time: 0.554228 Dec 15 16:22:28.139626 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-a398e114-319b-4f4e-91ea-598a8d910de0 tempest-VolumesGetTestJSON-781643080 tempest-VolumesGetTestJSON-781643080-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/d33015c7-7966-495c-b9f7-551646cf419c" status: 200 len: 352 microversion: 2.1 time: 0.354271 Dec 15 16:22:28.141585 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 101/206] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Dec 15 16:22:27 2021] GET /compute/v2.1/os-volumes/d33015c7-7966-495c-b9f7-551646cf419c => generated 352 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:22:28.148552 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 106/207] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:27 2021] GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e => generated 1520 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:28.160602 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-84a6c8e6-3de9-4765-b32e-4558ebc1519a tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:28.161657 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-84a6c8e6-3de9-4765-b32e-4558ebc1519a tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: e2e4e9fd-273e-4f05-811f-d997caf4636c] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:28.180270 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-84a6c8e6-3de9-4765-b32e-4558ebc1519a tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:28.181338 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-84a6c8e6-3de9-4765-b32e-4558ebc1519a tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:28.182327 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-84a6c8e6-3de9-4765-b32e-4558ebc1519a tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:28.187416 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-84a6c8e6-3de9-4765-b32e-4558ebc1519a tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:28.189123 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-e9a4b28f-5d97-4335-84c9-65be2f77fdac req-511553c1-4cca-4522-9457-aa6ed4a31960 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96617b99-e916-4aa8-a3f5-3ef4ed329f04", "tag": "6cf0b461-3217-430a-af34-dbc9203f9ae3"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:28.194509 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:22:28.194509 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:22:28.246668 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-e9a4b28f-5d97-4335-84c9-65be2f77fdac req-511553c1-4cca-4522-9457-aa6ed4a31960 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:28.247175 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-e9a4b28f-5d97-4335-84c9-65be2f77fdac req-511553c1-4cca-4522-9457-aa6ed4a31960 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:28.282606 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-e9a4b28f-5d97-4335-84c9-65be2f77fdac req-511553c1-4cca-4522-9457-aa6ed4a31960 service nova] Creating event network-changed:6cf0b461-3217-430a-af34-dbc9203f9ae3 for instance 96617b99-e916-4aa8-a3f5-3ef4ed329f04 on hv-cinder-81268 Dec 15 16:22:28.304219 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-e9a4b28f-5d97-4335-84c9-65be2f77fdac req-511553c1-4cca-4522-9457-aa6ed4a31960 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156976 Dec 15 16:22:28.306389 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 102/208] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:22:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:22:28.319601 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-21013dfc-a472-40dc-b7ba-8fb6ce1dcde4 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:28.321996 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-21013dfc-a472-40dc-b7ba-8fb6ce1dcde4 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:28.348735 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-21013dfc-a472-40dc-b7ba-8fb6ce1dcde4 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:28.349992 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-21013dfc-a472-40dc-b7ba-8fb6ce1dcde4 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:28.354580 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-21013dfc-a472-40dc-b7ba-8fb6ce1dcde4 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:28.355847 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-21013dfc-a472-40dc-b7ba-8fb6ce1dcde4 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:28.507393 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-21013dfc-a472-40dc-b7ba-8fb6ce1dcde4 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action" status: 200 len: 25341 microversion: 2.1 time: 0.198460 Dec 15 16:22:28.508430 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 103/209] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:22:28 2021] POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action => generated 25341 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:22:28.639510 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-84a6c8e6-3de9-4765-b32e-4558ebc1519a tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:28.663322 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-84a6c8e6-3de9-4765-b32e-4558ebc1519a tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/e2e4e9fd-273e-4f05-811f-d997caf4636c" status: 200 len: 1318 microversion: 2.1 time: 0.513040 Dec 15 16:22:28.664274 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 107/210] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:28 2021] GET /compute/v2.1/servers/e2e4e9fd-273e-4f05-811f-d997caf4636c => generated 1318 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:28.800590 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-dffe6ebf-3e67-4cb4-bed6-565872ddb0f0 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:28.801513 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-dffe6ebf-3e67-4cb4-bed6-565872ddb0f0 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] [instance: 96617b99-e916-4aa8-a3f5-3ef4ed329f04] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:28.812023 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dffe6ebf-3e67-4cb4-bed6-565872ddb0f0 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:28.814683 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dffe6ebf-3e67-4cb4-bed6-565872ddb0f0 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:28.816007 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dffe6ebf-3e67-4cb4-bed6-565872ddb0f0 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:28.816584 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dffe6ebf-3e67-4cb4-bed6-565872ddb0f0 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:29.046250 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-dffe6ebf-3e67-4cb4-bed6-565872ddb0f0 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb9f7ee83454ee38fd6d0ef1db12c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c056527e8db4053b789853fcf928010', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:29.060093 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-dffe6ebf-3e67-4cb4-bed6-565872ddb0f0 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] 10.222.0.60 "GET /compute/v2.1/servers/96617b99-e916-4aa8-a3f5-3ef4ed329f04" status: 200 len: 1313 microversion: 2.1 time: 0.265052 Dec 15 16:22:29.075900 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 104/211] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:28 2021] GET /compute/v2.1/servers/96617b99-e916-4aa8-a3f5-3ef4ed329f04 => generated 1313 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:29.170843 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-df7f0068-a0ad-4600-a704-64ed4993289b tempest-VolumesGetTestJSON-781643080 tempest-VolumesGetTestJSON-781643080-project] Calling method '.version_select at 0x7f0b27685ee0>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:29.180987 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d51cfbb0-2bfa-4e2e-86b2-3dd22b3f754f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:29.181893 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d51cfbb0-2bfa-4e2e-86b2-3dd22b3f754f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: bb8ad3f4-a466-4385-9311-93476fe7304e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:29.205901 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d51cfbb0-2bfa-4e2e-86b2-3dd22b3f754f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:29.206572 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d51cfbb0-2bfa-4e2e-86b2-3dd22b3f754f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:29.207509 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d51cfbb0-2bfa-4e2e-86b2-3dd22b3f754f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:29.208037 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d51cfbb0-2bfa-4e2e-86b2-3dd22b3f754f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:29.313515 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-df7f0068-a0ad-4600-a704-64ed4993289b tempest-VolumesGetTestJSON-781643080 tempest-VolumesGetTestJSON-781643080-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/d33015c7-7966-495c-b9f7-551646cf419c" status: 200 len: 353 microversion: 2.1 time: 0.153196 Dec 15 16:22:29.314838 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 108/212] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Dec 15 16:22:29 2021] GET /compute/v2.1/os-volumes/d33015c7-7966-495c-b9f7-551646cf419c => generated 353 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:22:29.339111 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-a84fa521-bf09-4948-ad9b-438f93cdcfce tempest-VolumesGetTestJSON-781643080 tempest-VolumesGetTestJSON-781643080-project] Calling method '.version_select at 0x7f0b26c5d0d0>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:29.449769 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d51cfbb0-2bfa-4e2e-86b2-3dd22b3f754f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:29.457403 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-a84fa521-bf09-4948-ad9b-438f93cdcfce tempest-VolumesGetTestJSON-781643080 tempest-VolumesGetTestJSON-781643080-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/d33015c7-7966-495c-b9f7-551646cf419c" status: 200 len: 353 microversion: 2.1 time: 0.129370 Dec 15 16:22:29.458804 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 109/213] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Dec 15 16:22:29 2021] GET /compute/v2.1/os-volumes/d33015c7-7966-495c-b9f7-551646cf419c => generated 353 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:22:29.459096 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d51cfbb0-2bfa-4e2e-86b2-3dd22b3f754f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e" status: 200 len: 1520 microversion: 2.1 time: 0.285397 Dec 15 16:22:29.469283 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 105/214] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:29 2021] GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e => generated 1520 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:29.475017 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-e0f2b812-be4a-4bd0-b9b0-7ce8e60d66dd tempest-VolumesGetTestJSON-781643080 tempest-VolumesGetTestJSON-781643080-project] Calling method '.version_select at 0x7f0b26cf5430>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:29.530804 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-6ad23663-a9c1-4c9f-be21-3d2e6853da77 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:29.534322 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-6ad23663-a9c1-4c9f-be21-3d2e6853da77 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:29.546020 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6ad23663-a9c1-4c9f-be21-3d2e6853da77 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:29.547477 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6ad23663-a9c1-4c9f-be21-3d2e6853da77 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:29.549204 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6ad23663-a9c1-4c9f-be21-3d2e6853da77 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:29.552053 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6ad23663-a9c1-4c9f-be21-3d2e6853da77 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:29.572721 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-e0f2b812-be4a-4bd0-b9b0-7ce8e60d66dd tempest-VolumesGetTestJSON-781643080 tempest-VolumesGetTestJSON-781643080-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/d33015c7-7966-495c-b9f7-551646cf419c" status: 202 len: 0 microversion: 2.1 time: 0.101430 Dec 15 16:22:29.575784 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 110/215] 10.222.0.60 () {58 vars in 1247 bytes} [Wed Dec 15 16:22:29 2021] DELETE /compute/v2.1/os-volumes/d33015c7-7966-495c-b9f7-551646cf419c => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:22:29.585891 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-867c83fe-a377-41df-a3e1-a4bef21ab68c tempest-VolumesGetTestJSON-781643080 tempest-VolumesGetTestJSON-781643080-project] Calling method '.version_select at 0x7f0b276a6b80>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:29.655185 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-867c83fe-a377-41df-a3e1-a4bef21ab68c tempest-VolumesGetTestJSON-781643080 tempest-VolumesGetTestJSON-781643080-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/d33015c7-7966-495c-b9f7-551646cf419c" status: 200 len: 352 microversion: 2.1 time: 0.074265 Dec 15 16:22:29.657419 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 111/216] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Dec 15 16:22:29 2021] GET /compute/v2.1/os-volumes/d33015c7-7966-495c-b9f7-551646cf419c => generated 352 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:22:29.681250 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-bb1048cb-e240-47e1-80fb-484f66cc5dc0 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:29.681964 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-bb1048cb-e240-47e1-80fb-484f66cc5dc0 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: e2e4e9fd-273e-4f05-811f-d997caf4636c] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:29.690851 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bb1048cb-e240-47e1-80fb-484f66cc5dc0 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:29.691259 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bb1048cb-e240-47e1-80fb-484f66cc5dc0 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:29.692303 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bb1048cb-e240-47e1-80fb-484f66cc5dc0 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:29.692626 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bb1048cb-e240-47e1-80fb-484f66cc5dc0 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:29.876610 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-bb1048cb-e240-47e1-80fb-484f66cc5dc0 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:29.892987 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-bb1048cb-e240-47e1-80fb-484f66cc5dc0 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/e2e4e9fd-273e-4f05-811f-d997caf4636c" status: 200 len: 1507 microversion: 2.1 time: 0.214992 Dec 15 16:22:29.903997 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 112/217] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:29 2021] GET /compute/v2.1/servers/e2e4e9fd-273e-4f05-811f-d997caf4636c => generated 1507 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:29.916174 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-1e061ed6-5fb4-4ec6-91c6-fe67b77f3241 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bcfb1e1d-47b3-4883-8a5b-104597a6b3af"}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:29.917900 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-1e061ed6-5fb4-4ec6-91c6-fe67b77f3241 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: e2e4e9fd-273e-4f05-811f-d997caf4636c] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:29.925470 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1e061ed6-5fb4-4ec6-91c6-fe67b77f3241 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:29.926050 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1e061ed6-5fb4-4ec6-91c6-fe67b77f3241 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:29.927039 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1e061ed6-5fb4-4ec6-91c6-fe67b77f3241 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:29.927616 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1e061ed6-5fb4-4ec6-91c6-fe67b77f3241 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:30.031760 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.wsgi [None req-1e061ed6-5fb4-4ec6-91c6-fe67b77f3241 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] HTTP exception thrown: Invalid volume: volume bcfb1e1d-47b3-4883-8a5b-104597a6b3af is already attached to instances: 365b5223-e068-4113-abe1-797e13f5e901 Dec 15 16:22:30.032650 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-1e061ed6-5fb4-4ec6-91c6-fe67b77f3241 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Returning 400 to user: Invalid volume: volume bcfb1e1d-47b3-4883-8a5b-104597a6b3af is already attached to instances: 365b5223-e068-4113-abe1-797e13f5e901 {{(pid=116085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:22:30.033671 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-1e061ed6-5fb4-4ec6-91c6-fe67b77f3241 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "POST /compute/v2.1/servers/e2e4e9fd-273e-4f05-811f-d997caf4636c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.122290 Dec 15 16:22:30.034258 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 113/218] 10.222.0.60 () {60 vars in 1322 bytes} [Wed Dec 15 16:22:29 2021] POST /compute/v2.1/servers/e2e4e9fd-273e-4f05-811f-d997caf4636c/os-volume_attachments => generated 174 bytes in 124 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 15 16:22:30.086998 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-2e4e9fb1-fc33-4ac0-acf2-10d2f02848d8 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:30.087659 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-2e4e9fb1-fc33-4ac0-acf2-10d2f02848d8 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] [instance: 96617b99-e916-4aa8-a3f5-3ef4ed329f04] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:30.096750 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2e4e9fb1-fc33-4ac0-acf2-10d2f02848d8 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:30.097373 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2e4e9fb1-fc33-4ac0-acf2-10d2f02848d8 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:30.111780 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2e4e9fb1-fc33-4ac0-acf2-10d2f02848d8 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:30.111780 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2e4e9fb1-fc33-4ac0-acf2-10d2f02848d8 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:30.266682 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-2e4e9fb1-fc33-4ac0-acf2-10d2f02848d8 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb9f7ee83454ee38fd6d0ef1db12c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c056527e8db4053b789853fcf928010', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:30.275784 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-2e4e9fb1-fc33-4ac0-acf2-10d2f02848d8 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] 10.222.0.60 "GET /compute/v2.1/servers/96617b99-e916-4aa8-a3f5-3ef4ed329f04" status: 200 len: 1313 microversion: 2.1 time: 0.192422 Dec 15 16:22:30.276373 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 114/219] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:30 2021] GET /compute/v2.1/servers/96617b99-e916-4aa8-a3f5-3ef4ed329f04 => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:22:30.281351 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-cd5d78ca-5334-4170-81a2-5a4a5b1cc34b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:30.282620 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-cd5d78ca-5334-4170-81a2-5a4a5b1cc34b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: 365b5223-e068-4113-abe1-797e13f5e901] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:30.290504 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-cd5d78ca-5334-4170-81a2-5a4a5b1cc34b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:30.291109 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-cd5d78ca-5334-4170-81a2-5a4a5b1cc34b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:30.292029 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-cd5d78ca-5334-4170-81a2-5a4a5b1cc34b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:30.292621 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-cd5d78ca-5334-4170-81a2-5a4a5b1cc34b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:30.453835 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.objects.instance [None req-cd5d78ca-5334-4170-81a2-5a4a5b1cc34b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lazy-loading 'services' on Instance uuid 365b5223-e068-4113-abe1-797e13f5e901 {{(pid=116085) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:22:30.581831 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-cd5d78ca-5334-4170-81a2-5a4a5b1cc34b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "DELETE /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901/os-volume_attachments/bcfb1e1d-47b3-4883-8a5b-104597a6b3af" status: 202 len: 0 microversion: 2.1 time: 0.303717 Dec 15 16:22:30.588044 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 115/220] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Dec 15 16:22:30 2021] DELETE /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901/os-volume_attachments/bcfb1e1d-47b3-4883-8a5b-104597a6b3af => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:22:30.591178 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-0d5e5671-24c7-4684-a56e-1b029cfa1619 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:30.592046 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-0d5e5671-24c7-4684-a56e-1b029cfa1619 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: bb8ad3f4-a466-4385-9311-93476fe7304e] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:30.599789 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0d5e5671-24c7-4684-a56e-1b029cfa1619 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:30.600245 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0d5e5671-24c7-4684-a56e-1b029cfa1619 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:30.601064 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0d5e5671-24c7-4684-a56e-1b029cfa1619 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:30.601503 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0d5e5671-24c7-4684-a56e-1b029cfa1619 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:30.785850 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-0d5e5671-24c7-4684-a56e-1b029cfa1619 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:30.794621 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-0d5e5671-24c7-4684-a56e-1b029cfa1619 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e" status: 200 len: 1520 microversion: 2.1 time: 0.209863 Dec 15 16:22:30.795416 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 116/221] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:30 2021] GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:30.804429 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-6079ff8b-8197-4b3f-81f4-b87d0b7ecc47 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:30.806254 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-6079ff8b-8197-4b3f-81f4-b87d0b7ecc47 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: 365b5223-e068-4113-abe1-797e13f5e901] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:30.815864 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6079ff8b-8197-4b3f-81f4-b87d0b7ecc47 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:30.817797 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6079ff8b-8197-4b3f-81f4-b87d0b7ecc47 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:30.817797 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6079ff8b-8197-4b3f-81f4-b87d0b7ecc47 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:30.817797 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6079ff8b-8197-4b3f-81f4-b87d0b7ecc47 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:30.856415 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-6079ff8b-8197-4b3f-81f4-b87d0b7ecc47 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059222 Dec 15 16:22:30.857457 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 117/222] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Dec 15 16:22:30 2021] GET /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:22:30.866030 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-b9a7035e-8da0-42ad-8ddb-ec5486c6280c tempest-VolumesGetTestJSON-781643080 tempest-VolumesGetTestJSON-781643080-project] Calling method '.version_select at 0x7f0b26c5dd30>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:30.931398 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-b9a7035e-8da0-42ad-8ddb-ec5486c6280c tempest-VolumesGetTestJSON-781643080 tempest-VolumesGetTestJSON-781643080-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/d33015c7-7966-495c-b9f7-551646cf419c" status: 200 len: 352 microversion: 2.1 time: 0.072431 Dec 15 16:22:30.932092 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 118/223] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Dec 15 16:22:30 2021] GET /compute/v2.1/os-volumes/d33015c7-7966-495c-b9f7-551646cf419c => generated 352 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:22:31.298677 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-dfbbd563-bc55-4ee6-8c9c-685d488bf7a8 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:31.299402 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-dfbbd563-bc55-4ee6-8c9c-685d488bf7a8 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] [instance: 96617b99-e916-4aa8-a3f5-3ef4ed329f04] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:31.305881 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-dfbbd563-bc55-4ee6-8c9c-685d488bf7a8 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:31.306340 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-dfbbd563-bc55-4ee6-8c9c-685d488bf7a8 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:31.307126 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-dfbbd563-bc55-4ee6-8c9c-685d488bf7a8 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:31.307606 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-dfbbd563-bc55-4ee6-8c9c-685d488bf7a8 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:31.453634 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-dfbbd563-bc55-4ee6-8c9c-685d488bf7a8 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb9f7ee83454ee38fd6d0ef1db12c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c056527e8db4053b789853fcf928010', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:31.461991 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-dfbbd563-bc55-4ee6-8c9c-685d488bf7a8 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] 10.222.0.60 "GET /compute/v2.1/servers/96617b99-e916-4aa8-a3f5-3ef4ed329f04" status: 200 len: 1313 microversion: 2.1 time: 0.168064 Dec 15 16:22:31.462585 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 119/224] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:31 2021] GET /compute/v2.1/servers/96617b99-e916-4aa8-a3f5-3ef4ed329f04 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:31.756962 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-6ad23663-a9c1-4c9f-be21-3d2e6853da77 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action" status: 200 len: 27669 microversion: 2.1 time: 2.236191 Dec 15 16:22:31.757855 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 106/225] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:22:29 2021] POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action => generated 27669 bytes in 2239 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:22:31.820759 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-d9b204f1-b5a0-4538-8cdf-34a72271ea26 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:31.821367 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-d9b204f1-b5a0-4538-8cdf-34a72271ea26 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: bb8ad3f4-a466-4385-9311-93476fe7304e] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:31.828330 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d9b204f1-b5a0-4538-8cdf-34a72271ea26 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:31.829208 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d9b204f1-b5a0-4538-8cdf-34a72271ea26 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:31.830012 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d9b204f1-b5a0-4538-8cdf-34a72271ea26 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:31.830447 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d9b204f1-b5a0-4538-8cdf-34a72271ea26 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:31.872099 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-161e0bef-300e-41e9-bbb5-1c2d05928273 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:31.873359 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-161e0bef-300e-41e9-bbb5-1c2d05928273 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: 365b5223-e068-4113-abe1-797e13f5e901] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:31.893107 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-161e0bef-300e-41e9-bbb5-1c2d05928273 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:31.893547 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-161e0bef-300e-41e9-bbb5-1c2d05928273 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:31.894519 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-161e0bef-300e-41e9-bbb5-1c2d05928273 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:31.894945 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-161e0bef-300e-41e9-bbb5-1c2d05928273 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:31.934891 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-161e0bef-300e-41e9-bbb5-1c2d05928273 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068018 Dec 15 16:22:31.935880 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 107/226] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Dec 15 16:22:31 2021] GET /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:22:31.947629 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-da6b86bb-6e2a-4a12-bba6-d8ae2d62e1f5 tempest-VolumesGetTestJSON-781643080 tempest-VolumesGetTestJSON-781643080-project] Calling method '.version_select at 0x7f0b273eeca0>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:32.008296 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-da6b86bb-6e2a-4a12-bba6-d8ae2d62e1f5 tempest-VolumesGetTestJSON-781643080 tempest-VolumesGetTestJSON-781643080-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/d33015c7-7966-495c-b9f7-551646cf419c" status: 200 len: 352 microversion: 2.1 time: 0.064230 Dec 15 16:22:32.009057 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 108/227] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Dec 15 16:22:31 2021] GET /compute/v2.1/os-volumes/d33015c7-7966-495c-b9f7-551646cf419c => generated 352 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:22:32.010858 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-d9b204f1-b5a0-4538-8cdf-34a72271ea26 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:32.023403 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-d9b204f1-b5a0-4538-8cdf-34a72271ea26 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e" status: 200 len: 1520 microversion: 2.1 time: 0.205980 Dec 15 16:22:32.025036 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 120/228] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:31 2021] GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e => generated 1520 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:32.479498 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-6c6f11a2-acf5-46ff-88d3-9b8ceae5575c tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:32.480105 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-6c6f11a2-acf5-46ff-88d3-9b8ceae5575c tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] [instance: 96617b99-e916-4aa8-a3f5-3ef4ed329f04] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:32.486848 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6c6f11a2-acf5-46ff-88d3-9b8ceae5575c tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:32.487296 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6c6f11a2-acf5-46ff-88d3-9b8ceae5575c tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:32.488103 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6c6f11a2-acf5-46ff-88d3-9b8ceae5575c tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:32.488537 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6c6f11a2-acf5-46ff-88d3-9b8ceae5575c tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:32.639049 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-6c6f11a2-acf5-46ff-88d3-9b8ceae5575c tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb9f7ee83454ee38fd6d0ef1db12c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c056527e8db4053b789853fcf928010', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:32.647796 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-6c6f11a2-acf5-46ff-88d3-9b8ceae5575c tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] 10.222.0.60 "GET /compute/v2.1/servers/96617b99-e916-4aa8-a3f5-3ef4ed329f04" status: 200 len: 1313 microversion: 2.1 time: 0.172810 Dec 15 16:22:32.648371 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 109/229] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:32 2021] GET /compute/v2.1/servers/96617b99-e916-4aa8-a3f5-3ef4ed329f04 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:32.770267 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-423183be-1157-46dd-ac47-e66cf84e333e tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:32.771250 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-423183be-1157-46dd-ac47-e66cf84e333e tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:32.778993 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-423183be-1157-46dd-ac47-e66cf84e333e tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:32.779483 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-423183be-1157-46dd-ac47-e66cf84e333e tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:32.780550 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-423183be-1157-46dd-ac47-e66cf84e333e tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:32.780876 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-423183be-1157-46dd-ac47-e66cf84e333e tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:32.880364 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-423183be-1157-46dd-ac47-e66cf84e333e tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action" status: 200 len: 27843 microversion: 2.1 time: 0.114609 Dec 15 16:22:32.881360 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 121/230] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:22:32 2021] POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action => generated 27843 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:22:32.948813 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-fcb0c666-49d2-45ac-8e1d-757213bc22f2 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:32.949956 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-fcb0c666-49d2-45ac-8e1d-757213bc22f2 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: 365b5223-e068-4113-abe1-797e13f5e901] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:32.957794 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fcb0c666-49d2-45ac-8e1d-757213bc22f2 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:32.958282 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fcb0c666-49d2-45ac-8e1d-757213bc22f2 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:32.959337 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fcb0c666-49d2-45ac-8e1d-757213bc22f2 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:32.959965 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fcb0c666-49d2-45ac-8e1d-757213bc22f2 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:33.000033 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-fcb0c666-49d2-45ac-8e1d-757213bc22f2 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055726 Dec 15 16:22:33.001100 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 110/231] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Dec 15 16:22:32 2021] GET /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:22:33.025870 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-9a2de122-3c9a-494e-9799-3c8da41c96d9 tempest-VolumesGetTestJSON-781643080 tempest-VolumesGetTestJSON-781643080-project] Calling method '.version_select at 0x7f0b26d67670>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:33.045839 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-59615200-108e-4bce-9e03-19542ea4a1f6 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:33.046675 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-59615200-108e-4bce-9e03-19542ea4a1f6 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: bb8ad3f4-a466-4385-9311-93476fe7304e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:33.053982 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-59615200-108e-4bce-9e03-19542ea4a1f6 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:33.054752 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-59615200-108e-4bce-9e03-19542ea4a1f6 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:33.055774 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-59615200-108e-4bce-9e03-19542ea4a1f6 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:33.056440 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-59615200-108e-4bce-9e03-19542ea4a1f6 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:33.125960 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.wsgi [None req-9a2de122-3c9a-494e-9799-3c8da41c96d9 tempest-VolumesGetTestJSON-781643080 tempest-VolumesGetTestJSON-781643080-project] HTTP exception thrown: Volume d33015c7-7966-495c-b9f7-551646cf419c could not be found. Dec 15 16:22:33.127528 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-9a2de122-3c9a-494e-9799-3c8da41c96d9 tempest-VolumesGetTestJSON-781643080 tempest-VolumesGetTestJSON-781643080-project] Returning 404 to user: Volume d33015c7-7966-495c-b9f7-551646cf419c could not be found. {{(pid=116085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:22:33.128798 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-9a2de122-3c9a-494e-9799-3c8da41c96d9 tempest-VolumesGetTestJSON-781643080 tempest-VolumesGetTestJSON-781643080-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/d33015c7-7966-495c-b9f7-551646cf419c" status: 404 len: 109 microversion: 2.1 time: 0.110538 Dec 15 16:22:33.129621 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 122/232] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Dec 15 16:22:33 2021] GET /compute/v2.1/os-volumes/d33015c7-7966-495c-b9f7-551646cf419c => generated 109 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:22:33.282442 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-59615200-108e-4bce-9e03-19542ea4a1f6 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:33.303076 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-0a8d786d-5948-4d6e-b34c-0596331fcebd tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2034007458", "imageRef": "b72b5f54-34d0-48ac-9484-bc8104a6dddb", "flavorRef": "452", "networks": [{"uuid": "d3a23e9e-8c1c-4ad2-af72-ef7451820760"}]}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:33.304372 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-59615200-108e-4bce-9e03-19542ea4a1f6 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e" status: 200 len: 1520 microversion: 2.1 time: 0.259434 Dec 15 16:22:33.311435 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 111/233] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:33 2021] GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e => generated 1520 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:33.438839 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.network.neutron [None req-0a8d786d-5948-4d6e-b34c-0596331fcebd tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] validate_networks() for [('d3a23e9e-8c1c-4ad2-af72-ef7451820760', None, None, None, None, None)] {{(pid=116085) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:22:33.670532 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-593f0203-966a-46f5-8d1f-44956b35465f tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:33.672180 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-593f0203-966a-46f5-8d1f-44956b35465f tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] [instance: 96617b99-e916-4aa8-a3f5-3ef4ed329f04] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:33.706953 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-593f0203-966a-46f5-8d1f-44956b35465f tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:33.710397 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-593f0203-966a-46f5-8d1f-44956b35465f tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:33.713247 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-593f0203-966a-46f5-8d1f-44956b35465f tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:33.713736 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-593f0203-966a-46f5-8d1f-44956b35465f tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:34.530190 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-593f0203-966a-46f5-8d1f-44956b35465f tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb9f7ee83454ee38fd6d0ef1db12c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c056527e8db4053b789853fcf928010', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:34.544389 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-593f0203-966a-46f5-8d1f-44956b35465f tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] 10.222.0.60 "GET /compute/v2.1/servers/96617b99-e916-4aa8-a3f5-3ef4ed329f04" status: 200 len: 1313 microversion: 2.1 time: 0.880550 Dec 15 16:22:34.545697 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 112/234] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:33 2021] GET /compute/v2.1/servers/96617b99-e916-4aa8-a3f5-3ef4ed329f04 => generated 1313 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:34.555287 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-dd050e72-a688-4c19-b548-af80cf369a0b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:34.557568 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-dd050e72-a688-4c19-b548-af80cf369a0b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:34.565896 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dd050e72-a688-4c19-b548-af80cf369a0b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:34.566702 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dd050e72-a688-4c19-b548-af80cf369a0b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:34.567945 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dd050e72-a688-4c19-b548-af80cf369a0b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:34.568745 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dd050e72-a688-4c19-b548-af80cf369a0b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:34.668623 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-dd050e72-a688-4c19-b548-af80cf369a0b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action" status: 200 len: 28222 microversion: 2.1 time: 0.120365 Dec 15 16:22:34.679314 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 113/235] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:22:34 2021] POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action => generated 28222 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:22:34.688814 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f50bd979-1de6-431f-a068-3f93e65f0c93 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:34.689508 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f50bd979-1de6-431f-a068-3f93e65f0c93 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: bb8ad3f4-a466-4385-9311-93476fe7304e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:34.699078 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f50bd979-1de6-431f-a068-3f93e65f0c93 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:34.699567 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f50bd979-1de6-431f-a068-3f93e65f0c93 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:34.700380 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f50bd979-1de6-431f-a068-3f93e65f0c93 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:34.700811 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f50bd979-1de6-431f-a068-3f93e65f0c93 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:34.811120 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-0a8d786d-5948-4d6e-b34c-0596331fcebd tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Flavor limits 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:22:34.812290 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-0a8d786d-5948-4d6e-b34c-0596331fcebd tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Image limits 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:22:34.813092 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-0a8d786d-5948-4d6e-b34c-0596331fcebd tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Flavor pref 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:22:34.813706 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-0a8d786d-5948-4d6e-b34c-0596331fcebd tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Image pref 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:22:34.814250 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-0a8d786d-5948-4d6e-b34c-0596331fcebd tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:22:34.824742 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0a8d786d-5948-4d6e-b34c-0596331fcebd tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:34.825583 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0a8d786d-5948-4d6e-b34c-0596331fcebd tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:34.826512 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0a8d786d-5948-4d6e-b34c-0596331fcebd tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:34.827195 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0a8d786d-5948-4d6e-b34c-0596331fcebd tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:34.855921 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-0a8d786d-5948-4d6e-b34c-0596331fcebd tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Getting quotas for project 6cccb6b08dc94f04a5efa2624d350007. Resources: {'cores', 'instances', 'ram'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:22:34.861176 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-0a8d786d-5948-4d6e-b34c-0596331fcebd tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Getting quotas for user 27c81feca86e49f193efb42a81a6c3c1 and project 6cccb6b08dc94f04a5efa2624d350007. Resources: {'cores', 'instances', 'ram'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:22:34.881467 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-0a8d786d-5948-4d6e-b34c-0596331fcebd tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Going to run 1 instances... {{(pid=116085) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:22:34.884202 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-0a8d786d-5948-4d6e-b34c-0596331fcebd tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: fefd60c0-a2af-4432-9260-c3046035cb4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b72b5f54-34d0-48ac-9484-bc8104a6dddb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116085) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:22:34.935620 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f50bd979-1de6-431f-a068-3f93e65f0c93 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:34.936002 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-0a8d786d-5948-4d6e-b34c-0596331fcebd tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.638185 Dec 15 16:22:34.941789 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 123/236] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Dec 15 16:22:33 2021] POST /compute/v2.1/servers => generated 380 bytes in 1640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 15 16:22:34.948556 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-d03eff37-7bb6-44ae-89eb-71fb35098477 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:34.949412 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-d03eff37-7bb6-44ae-89eb-71fb35098477 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: fefd60c0-a2af-4432-9260-c3046035cb4f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:34.950828 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f50bd979-1de6-431f-a068-3f93e65f0c93 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e" status: 200 len: 1520 microversion: 2.1 time: 0.268179 Dec 15 16:22:34.951708 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 114/237] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:34 2021] GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e => generated 1520 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:35.031015 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-d03eff37-7bb6-44ae-89eb-71fb35098477 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:35.039130 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-d03eff37-7bb6-44ae-89eb-71fb35098477 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f" status: 200 len: 1218 microversion: 2.1 time: 0.095842 Dec 15 16:22:35.042027 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 124/238] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:34 2021] GET /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:35.575113 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-6e4c4725-6caf-4c23-849a-a7b00ebe4388 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:35.575862 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-6e4c4725-6caf-4c23-849a-a7b00ebe4388 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] [instance: 96617b99-e916-4aa8-a3f5-3ef4ed329f04] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:35.592645 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6e4c4725-6caf-4c23-849a-a7b00ebe4388 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:35.593071 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6e4c4725-6caf-4c23-849a-a7b00ebe4388 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:35.593880 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6e4c4725-6caf-4c23-849a-a7b00ebe4388 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:35.600960 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6e4c4725-6caf-4c23-849a-a7b00ebe4388 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:35.688566 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-3e230df6-3193-4077-96f1-9e38f2f24c8e tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:35.690131 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-3e230df6-3193-4077-96f1-9e38f2f24c8e tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:35.715802 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3e230df6-3193-4077-96f1-9e38f2f24c8e tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:35.716387 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3e230df6-3193-4077-96f1-9e38f2f24c8e tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:35.719874 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3e230df6-3193-4077-96f1-9e38f2f24c8e tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:35.721197 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3e230df6-3193-4077-96f1-9e38f2f24c8e tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:35.926826 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-3e230df6-3193-4077-96f1-9e38f2f24c8e tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action" status: 200 len: 28513 microversion: 2.1 time: 0.243038 Dec 15 16:22:35.929160 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 125/239] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:22:35 2021] POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action => generated 28513 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:22:35.945050 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-9eefb627-a689-43a1-9469-5cb2a5266cdd req-91ac7a95-168b-4d2f-b339-b0769211bc7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96617b99-e916-4aa8-a3f5-3ef4ed329f04", "name": "network-vif-plugged", "status": "completed", "tag": "6cf0b461-3217-430a-af34-dbc9203f9ae3"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:35.947813 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:22:35.947813 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Dec 15 16:22:35.966455 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-6e4c4725-6caf-4c23-849a-a7b00ebe4388 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb9f7ee83454ee38fd6d0ef1db12c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c056527e8db4053b789853fcf928010', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:35.986650 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-9eefb627-a689-43a1-9469-5cb2a5266cdd req-91ac7a95-168b-4d2f-b339-b0769211bc7a service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:35.988369 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-9eefb627-a689-43a1-9469-5cb2a5266cdd req-91ac7a95-168b-4d2f-b339-b0769211bc7a service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:35.989815 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-6e4c4725-6caf-4c23-849a-a7b00ebe4388 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] 10.222.0.60 "GET /compute/v2.1/servers/96617b99-e916-4aa8-a3f5-3ef4ed329f04" status: 200 len: 1313 microversion: 2.1 time: 0.416610 Dec 15 16:22:35.990834 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 115/240] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:35 2021] GET /compute/v2.1/servers/96617b99-e916-4aa8-a3f5-3ef4ed329f04 => generated 1313 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:36.003457 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-41324672-7004-455c-9ada-a466c9ee57e5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:36.008421 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-41324672-7004-455c-9ada-a466c9ee57e5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: bb8ad3f4-a466-4385-9311-93476fe7304e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:36.021811 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-41324672-7004-455c-9ada-a466c9ee57e5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:36.022956 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-41324672-7004-455c-9ada-a466c9ee57e5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:36.024139 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-41324672-7004-455c-9ada-a466c9ee57e5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:36.024852 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-41324672-7004-455c-9ada-a466c9ee57e5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:36.037134 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-9eefb627-a689-43a1-9469-5cb2a5266cdd req-91ac7a95-168b-4d2f-b339-b0769211bc7a service nova] Creating event network-vif-plugged:6cf0b461-3217-430a-af34-dbc9203f9ae3 for instance 96617b99-e916-4aa8-a3f5-3ef4ed329f04 on hv-cinder-81268 Dec 15 16:22:36.051672 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-9eefb627-a689-43a1-9469-5cb2a5266cdd req-91ac7a95-168b-4d2f-b339-b0769211bc7a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119190 Dec 15 16:22:36.053596 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 126/241] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:22:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:22:36.084327 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-4ee26a46-0a42-4863-8280-7441587aca5b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:36.088844 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-4ee26a46-0a42-4863-8280-7441587aca5b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: fefd60c0-a2af-4432-9260-c3046035cb4f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:36.101649 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4ee26a46-0a42-4863-8280-7441587aca5b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:36.102168 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4ee26a46-0a42-4863-8280-7441587aca5b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:36.103430 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4ee26a46-0a42-4863-8280-7441587aca5b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:36.103950 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4ee26a46-0a42-4863-8280-7441587aca5b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:36.240209 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-4ee26a46-0a42-4863-8280-7441587aca5b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:36.251897 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-4ee26a46-0a42-4863-8280-7441587aca5b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f" status: 200 len: 1270 microversion: 2.1 time: 0.187071 Dec 15 16:22:36.252503 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 127/242] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:36 2021] GET /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f => generated 1270 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:36.357202 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-41324672-7004-455c-9ada-a466c9ee57e5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:36.366849 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-41324672-7004-455c-9ada-a466c9ee57e5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e" status: 200 len: 1500 microversion: 2.1 time: 0.367877 Dec 15 16:22:36.367582 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 116/243] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:35 2021] GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e => generated 1500 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:36.388707 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-25772649-ab0f-47a3-8cc5-068a7e4b93ba tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:36.390241 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-25772649-ab0f-47a3-8cc5-068a7e4b93ba tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:36.404027 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-25772649-ab0f-47a3-8cc5-068a7e4b93ba tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:36.405471 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-25772649-ab0f-47a3-8cc5-068a7e4b93ba tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:36.408564 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-25772649-ab0f-47a3-8cc5-068a7e4b93ba tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:36.409690 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-25772649-ab0f-47a3-8cc5-068a7e4b93ba tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:36.780235 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-25772649-ab0f-47a3-8cc5-068a7e4b93ba tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:36.805282 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-25772649-ab0f-47a3-8cc5-068a7e4b93ba tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1514 microversion: 2.1 time: 0.423291 Dec 15 16:22:36.808568 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 128/244] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:36 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1514 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:36.987437 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-d0f9d384-23ac-4c7d-804a-8c84935008a9 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:36.998036 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-d0f9d384-23ac-4c7d-804a-8c84935008a9 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:37.034709 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d0f9d384-23ac-4c7d-804a-8c84935008a9 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:37.035770 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d0f9d384-23ac-4c7d-804a-8c84935008a9 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:37.042700 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d0f9d384-23ac-4c7d-804a-8c84935008a9 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:37.044103 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-72b9f1e3-5d5f-4d1c-a5b1-2adb510c5830 tempest-VolumesNegativeTest-438444988 tempest-VolumesNegativeTest-438444988-project] Action: 'create', calling method: .version_select at 0x7f0b27540af0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1249029384", "metadata": {"Type": "work"}}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:37.045638 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-72b9f1e3-5d5f-4d1c-a5b1-2adb510c5830 tempest-VolumesNegativeTest-438444988 tempest-VolumesNegativeTest-438444988-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:22:37.046469 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-72b9f1e3-5d5f-4d1c-a5b1-2adb510c5830 tempest-VolumesNegativeTest-438444988 tempest-VolumesNegativeTest-438444988-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.345015 Dec 15 16:22:37.046972 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d0f9d384-23ac-4c7d-804a-8c84935008a9 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:37.047430 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 117/245] 10.222.0.60 () {60 vars in 1155 bytes} [Wed Dec 15 16:22:36 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 347 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Dec 15 16:22:37.056783 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e2219b2b-ff93-439e-a02f-a36209dba82f tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:37.061706 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e2219b2b-ff93-439e-a02f-a36209dba82f tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] [instance: 96617b99-e916-4aa8-a3f5-3ef4ed329f04] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:37.093709 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e2219b2b-ff93-439e-a02f-a36209dba82f tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:37.095408 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e2219b2b-ff93-439e-a02f-a36209dba82f tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:37.097774 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e2219b2b-ff93-439e-a02f-a36209dba82f tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:37.098684 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e2219b2b-ff93-439e-a02f-a36209dba82f tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:37.256625 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-d0f9d384-23ac-4c7d-804a-8c84935008a9 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action" status: 200 len: 28514 microversion: 2.1 time: 0.305962 Dec 15 16:22:37.265263 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 129/246] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:22:36 2021] POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action => generated 28514 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:22:37.282014 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-01eb4363-630b-41b2-b7b6-5af6a9383f41 tempest-VolumesNegativeTest-438444988 tempest-VolumesNegativeTest-438444988-project] Action: 'create', calling method: .version_select at 0x7f0b26cf5b80>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1874861070", "metadata": {"Type": "work"}}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:37.286072 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-01eb4363-630b-41b2-b7b6-5af6a9383f41 tempest-VolumesNegativeTest-438444988 tempest-VolumesNegativeTest-438444988-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:22:37.288885 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-01eb4363-630b-41b2-b7b6-5af6a9383f41 tempest-VolumesNegativeTest-438444988 tempest-VolumesNegativeTest-438444988-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.020388 Dec 15 16:22:37.289991 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 130/247] 10.222.0.60 () {60 vars in 1155 bytes} [Wed Dec 15 16:22:37 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 15 16:22:37.309225 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-f749680f-3efa-4014-a5f5-573e30a57a45 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:37.310316 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-f749680f-3efa-4014-a5f5-573e30a57a45 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: fefd60c0-a2af-4432-9260-c3046035cb4f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:37.326768 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f749680f-3efa-4014-a5f5-573e30a57a45 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:37.327625 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f749680f-3efa-4014-a5f5-573e30a57a45 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:37.349625 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f749680f-3efa-4014-a5f5-573e30a57a45 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:37.350145 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f749680f-3efa-4014-a5f5-573e30a57a45 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:37.627677 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-f749680f-3efa-4014-a5f5-573e30a57a45 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:37.646163 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-f749680f-3efa-4014-a5f5-573e30a57a45 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f" status: 200 len: 1276 microversion: 2.1 time: 0.351371 Dec 15 16:22:37.648709 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 131/248] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:37 2021] GET /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f => generated 1276 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:37.662906 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-a02dc56e-7b5d-465a-b1f5-3dc1fd0fbbe5 tempest-VolumesNegativeTest-438444988 tempest-VolumesNegativeTest-438444988-project] Action: 'create', calling method: .version_select at 0x7f0b26cc05e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-827595603", "metadata": {"Type": "work"}}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:37.668389 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-a02dc56e-7b5d-465a-b1f5-3dc1fd0fbbe5 tempest-VolumesNegativeTest-438444988 tempest-VolumesNegativeTest-438444988-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:22:37.671926 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e2219b2b-ff93-439e-a02f-a36209dba82f tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb9f7ee83454ee38fd6d0ef1db12c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c056527e8db4053b789853fcf928010', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:37.672428 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-a02dc56e-7b5d-465a-b1f5-3dc1fd0fbbe5 tempest-VolumesNegativeTest-438444988 tempest-VolumesNegativeTest-438444988-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.019585 Dec 15 16:22:37.675182 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 132/249] 10.222.0.60 () {60 vars in 1155 bytes} [Wed Dec 15 16:22:37 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 15 16:22:37.692065 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-324e4670-b491-404d-bec9-2cda35fc4fc7 tempest-VolumesNegativeTest-438444988 tempest-VolumesNegativeTest-438444988-project] Calling method '.version_select at 0x7f0b27693d30>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:37.699266 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e2219b2b-ff93-439e-a02f-a36209dba82f tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] 10.222.0.60 "GET /compute/v2.1/servers/96617b99-e916-4aa8-a3f5-3ef4ed329f04" status: 200 len: 1313 microversion: 2.1 time: 0.649324 Dec 15 16:22:37.708027 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 118/250] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:37 2021] GET /compute/v2.1/servers/96617b99-e916-4aa8-a3f5-3ef4ed329f04 => generated 1313 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:37.753929 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.wsgi [None req-324e4670-b491-404d-bec9-2cda35fc4fc7 tempest-VolumesNegativeTest-438444988 tempest-VolumesNegativeTest-438444988-project] HTTP exception thrown: Volume tempest-invalid-818266662 could not be found. Dec 15 16:22:37.754773 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-324e4670-b491-404d-bec9-2cda35fc4fc7 tempest-VolumesNegativeTest-438444988 tempest-VolumesNegativeTest-438444988-project] Returning 404 to user: Volume tempest-invalid-818266662 could not be found. {{(pid=116085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:22:37.756451 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-324e4670-b491-404d-bec9-2cda35fc4fc7 tempest-VolumesNegativeTest-438444988 tempest-VolumesNegativeTest-438444988-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/tempest-invalid-818266662" status: 404 len: 98 microversion: 2.1 time: 0.074866 Dec 15 16:22:37.757656 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 133/251] 10.222.0.60 () {58 vars in 1214 bytes} [Wed Dec 15 16:22:37 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-818266662 => generated 98 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 15 16:22:37.770432 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c34603b1-8e16-4a14-b216-961530fdcc3b tempest-VolumesNegativeTest-438444988 tempest-VolumesNegativeTest-438444988-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004422 Dec 15 16:22:37.771112 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 119/252] 10.222.0.60 () {58 vars in 1139 bytes} [Wed Dec 15 16:22:37 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 15 16:22:37.785724 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-8f832085-d8ab-4e8b-b419-555335a30683 tempest-VolumesNegativeTest-438444988 tempest-VolumesNegativeTest-438444988-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005848 Dec 15 16:22:37.786301 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 134/253] 10.222.0.60 () {58 vars in 1136 bytes} [Wed Dec 15 16:22:37 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 15 16:22:37.800634 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-a516e42f-c7d2-40b7-93e0-0f279148decd tempest-VolumesNegativeTest-438444988 tempest-VolumesNegativeTest-438444988-project] Calling method '.version_select at 0x7f0b288dbca0>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:37.870146 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-a516e42f-c7d2-40b7-93e0-0f279148decd tempest-VolumesNegativeTest-438444988 tempest-VolumesNegativeTest-438444988-project] HTTP exception thrown: Volume ea8cfdb2-2a7e-4acc-abc6-939ee0e52721 could not be found. Dec 15 16:22:37.870757 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-a516e42f-c7d2-40b7-93e0-0f279148decd tempest-VolumesNegativeTest-438444988 tempest-VolumesNegativeTest-438444988-project] Returning 404 to user: Volume ea8cfdb2-2a7e-4acc-abc6-939ee0e52721 could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:22:37.872469 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-a516e42f-c7d2-40b7-93e0-0f279148decd tempest-VolumesNegativeTest-438444988 tempest-VolumesNegativeTest-438444988-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/ea8cfdb2-2a7e-4acc-abc6-939ee0e52721" status: 404 len: 109 microversion: 2.1 time: 0.076739 Dec 15 16:22:37.874036 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 120/254] 10.222.0.60 () {58 vars in 1247 bytes} [Wed Dec 15 16:22:37 2021] DELETE /compute/v2.1/os-volumes/ea8cfdb2-2a7e-4acc-abc6-939ee0e52721 => generated 109 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 16:22:37.902006 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-9dcaf2db-d589-42c1-a304-f9385c47a826 tempest-VolumesNegativeTest-438444988 tempest-VolumesNegativeTest-438444988-project] Calling method '.version_select at 0x7f0b26bde550>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:37.974538 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.wsgi [None req-9dcaf2db-d589-42c1-a304-f9385c47a826 tempest-VolumesNegativeTest-438444988 tempest-VolumesNegativeTest-438444988-project] HTTP exception thrown: Volume bfc75a54-8eef-4d14-868d-4690f33e6009 could not be found. Dec 15 16:22:37.975479 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-9dcaf2db-d589-42c1-a304-f9385c47a826 tempest-VolumesNegativeTest-438444988 tempest-VolumesNegativeTest-438444988-project] Returning 404 to user: Volume bfc75a54-8eef-4d14-868d-4690f33e6009 could not be found. {{(pid=116085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:22:37.976348 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-9dcaf2db-d589-42c1-a304-f9385c47a826 tempest-VolumesNegativeTest-438444988 tempest-VolumesNegativeTest-438444988-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/bfc75a54-8eef-4d14-868d-4690f33e6009" status: 404 len: 109 microversion: 2.1 time: 0.088045 Dec 15 16:22:37.977194 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 135/255] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Dec 15 16:22:37 2021] GET /compute/v2.1/os-volumes/bfc75a54-8eef-4d14-868d-4690f33e6009 => generated 109 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:22:38.276070 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-a4032454-457c-463f-aaa2-ae4f452bdc38 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:38.280975 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-a4032454-457c-463f-aaa2-ae4f452bdc38 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:38.302501 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a4032454-457c-463f-aaa2-ae4f452bdc38 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:38.303901 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a4032454-457c-463f-aaa2-ae4f452bdc38 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:38.309018 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a4032454-457c-463f-aaa2-ae4f452bdc38 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:38.311946 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a4032454-457c-463f-aaa2-ae4f452bdc38 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:38.452230 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-a4032454-457c-463f-aaa2-ae4f452bdc38 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action" status: 200 len: 28681 microversion: 2.1 time: 0.182981 Dec 15 16:22:38.460738 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 121/256] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:22:38 2021] POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action => generated 28681 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:22:38.679001 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-fa5fca67-0b01-4e7d-89bc-8e84c2f5a22b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:38.679977 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-fa5fca67-0b01-4e7d-89bc-8e84c2f5a22b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: fefd60c0-a2af-4432-9260-c3046035cb4f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:38.689778 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fa5fca67-0b01-4e7d-89bc-8e84c2f5a22b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:38.690324 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fa5fca67-0b01-4e7d-89bc-8e84c2f5a22b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:38.691013 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fa5fca67-0b01-4e7d-89bc-8e84c2f5a22b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:38.691473 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fa5fca67-0b01-4e7d-89bc-8e84c2f5a22b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:38.735207 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-35bd48ce-1ed3-44c8-a7d7-8e697643edee tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:38.739190 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-35bd48ce-1ed3-44c8-a7d7-8e697643edee tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] [instance: 96617b99-e916-4aa8-a3f5-3ef4ed329f04] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:38.753213 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-35bd48ce-1ed3-44c8-a7d7-8e697643edee tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:38.765303 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-35bd48ce-1ed3-44c8-a7d7-8e697643edee tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:38.778186 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-35bd48ce-1ed3-44c8-a7d7-8e697643edee tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:38.778845 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-35bd48ce-1ed3-44c8-a7d7-8e697643edee tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:38.947605 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-fa5fca67-0b01-4e7d-89bc-8e84c2f5a22b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:38.955357 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-fa5fca67-0b01-4e7d-89bc-8e84c2f5a22b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f" status: 200 len: 1318 microversion: 2.1 time: 0.281454 Dec 15 16:22:38.956207 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 136/257] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:38 2021] GET /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f => generated 1318 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:22:38.963742 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-ef9e9a16-da80-440a-b5de-81a8a38082f9 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:38.965226 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-ef9e9a16-da80-440a-b5de-81a8a38082f9 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:38.971553 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ef9e9a16-da80-440a-b5de-81a8a38082f9 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:38.972260 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ef9e9a16-da80-440a-b5de-81a8a38082f9 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:38.975164 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ef9e9a16-da80-440a-b5de-81a8a38082f9 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:38.975683 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ef9e9a16-da80-440a-b5de-81a8a38082f9 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:39.010740 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.objects.instance [None req-ef9e9a16-da80-440a-b5de-81a8a38082f9 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lazy-loading 'flavor' on Instance uuid 129b3afd-1d85-4f6e-94c3-8e7a729ff532 {{(pid=116085) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:22:39.152874 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-ef9e9a16-da80-440a-b5de-81a8a38082f9 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "POST /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532/action" status: 200 len: 32 microversion: 2.1 time: 0.195318 Dec 15 16:22:39.153936 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 137/258] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:22:38 2021] POST /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532/action => generated 32 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:22:39.158086 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-35bd48ce-1ed3-44c8-a7d7-8e697643edee tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb9f7ee83454ee38fd6d0ef1db12c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c056527e8db4053b789853fcf928010', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:39.171696 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-35bd48ce-1ed3-44c8-a7d7-8e697643edee tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] 10.222.0.60 "GET /compute/v2.1/servers/96617b99-e916-4aa8-a3f5-3ef4ed329f04" status: 200 len: 1496 microversion: 2.1 time: 0.447548 Dec 15 16:22:39.172589 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 122/259] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:38 2021] GET /compute/v2.1/servers/96617b99-e916-4aa8-a3f5-3ef4ed329f04 => generated 1496 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:39.185769 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-a4a84e97-7507-4116-9d29-b06d64f477ee tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:39.186672 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-a4a84e97-7507-4116-9d29-b06d64f477ee tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:39.199809 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a4a84e97-7507-4116-9d29-b06d64f477ee tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:39.200277 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a4a84e97-7507-4116-9d29-b06d64f477ee tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:39.201397 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a4a84e97-7507-4116-9d29-b06d64f477ee tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:39.202743 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a4a84e97-7507-4116-9d29-b06d64f477ee tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:39.468318 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-6a01cd0c-343b-4287-84d1-e49e72790fd3 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:39.469632 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-6a01cd0c-343b-4287-84d1-e49e72790fd3 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:39.502123 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6a01cd0c-343b-4287-84d1-e49e72790fd3 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:39.503057 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6a01cd0c-343b-4287-84d1-e49e72790fd3 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:39.504145 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6a01cd0c-343b-4287-84d1-e49e72790fd3 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:39.504754 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6a01cd0c-343b-4287-84d1-e49e72790fd3 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:39.619808 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-6a01cd0c-343b-4287-84d1-e49e72790fd3 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action" status: 200 len: 28681 microversion: 2.1 time: 0.153143 Dec 15 16:22:39.623066 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 123/260] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:22:39 2021] POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action => generated 28681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:22:39.747758 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-a4a84e97-7507-4116-9d29-b06d64f477ee tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:39.769777 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-a4a84e97-7507-4116-9d29-b06d64f477ee tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1520 microversion: 2.1 time: 0.601228 Dec 15 16:22:39.771450 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 138/261] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:39 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1520 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:39.988827 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-80a25c52-1618-43f2-91c3-6d62cbf67397 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:39.997718 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-80a25c52-1618-43f2-91c3-6d62cbf67397 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: fefd60c0-a2af-4432-9260-c3046035cb4f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:40.037008 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-412243ff-285a-4b13-9e19-cbf3c98661cb tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:40.037964 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-412243ff-285a-4b13-9e19-cbf3c98661cb tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] [instance: 96617b99-e916-4aa8-a3f5-3ef4ed329f04] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:40.060611 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-80a25c52-1618-43f2-91c3-6d62cbf67397 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:40.066197 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-80a25c52-1618-43f2-91c3-6d62cbf67397 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:40.074507 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-412243ff-285a-4b13-9e19-cbf3c98661cb tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:40.075324 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-412243ff-285a-4b13-9e19-cbf3c98661cb tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:40.076237 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-80a25c52-1618-43f2-91c3-6d62cbf67397 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:40.077069 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-80a25c52-1618-43f2-91c3-6d62cbf67397 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:40.089425 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-412243ff-285a-4b13-9e19-cbf3c98661cb tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:40.092343 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-412243ff-285a-4b13-9e19-cbf3c98661cb tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:40.196461 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-412243ff-285a-4b13-9e19-cbf3c98661cb tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] [instance: 96617b99-e916-4aa8-a3f5-3ef4ed329f04] Going to try to terminate instance {{(pid=116085) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:22:40.460052 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-412243ff-285a-4b13-9e19-cbf3c98661cb tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] 10.222.0.60 "DELETE /compute/v2.1/servers/96617b99-e916-4aa8-a3f5-3ef4ed329f04" status: 204 len: 0 microversion: 2.1 time: 0.429744 Dec 15 16:22:40.460558 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 139/262] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Dec 15 16:22:40 2021] DELETE /compute/v2.1/servers/96617b99-e916-4aa8-a3f5-3ef4ed329f04 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 15 16:22:40.467224 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-80a25c52-1618-43f2-91c3-6d62cbf67397 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:40.475734 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-80a25c52-1618-43f2-91c3-6d62cbf67397 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f" status: 200 len: 1318 microversion: 2.1 time: 0.495651 Dec 15 16:22:40.481086 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 124/263] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:39 2021] GET /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f => generated 1318 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:40.488811 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-747f9975-8ff6-4482-8adc-4d0eaaede73a tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:40.493432 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-747f9975-8ff6-4482-8adc-4d0eaaede73a tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] [instance: 96617b99-e916-4aa8-a3f5-3ef4ed329f04] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:40.511541 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-747f9975-8ff6-4482-8adc-4d0eaaede73a tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:40.513899 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-747f9975-8ff6-4482-8adc-4d0eaaede73a tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:40.515536 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-747f9975-8ff6-4482-8adc-4d0eaaede73a tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:40.518533 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-747f9975-8ff6-4482-8adc-4d0eaaede73a tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:40.634671 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-bfcc0f00-6f87-45fa-97a6-6025e5f9e97d tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:40.635820 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-bfcc0f00-6f87-45fa-97a6-6025e5f9e97d tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:40.654411 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bfcc0f00-6f87-45fa-97a6-6025e5f9e97d tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:40.657559 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bfcc0f00-6f87-45fa-97a6-6025e5f9e97d tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:40.660235 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bfcc0f00-6f87-45fa-97a6-6025e5f9e97d tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:40.662524 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bfcc0f00-6f87-45fa-97a6-6025e5f9e97d tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:40.799264 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-bfcc0f00-6f87-45fa-97a6-6025e5f9e97d tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action" status: 200 len: 28681 microversion: 2.1 time: 0.168821 Dec 15 16:22:40.804908 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 125/264] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:22:40 2021] POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action => generated 28681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:22:40.813831 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-9a60d142-f0f6-41cc-8d84-eb9a10b1d4d5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:40.815297 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-9a60d142-f0f6-41cc-8d84-eb9a10b1d4d5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:40.818604 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-747f9975-8ff6-4482-8adc-4d0eaaede73a tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb9f7ee83454ee38fd6d0ef1db12c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c056527e8db4053b789853fcf928010', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:40.825503 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9a60d142-f0f6-41cc-8d84-eb9a10b1d4d5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:40.826371 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9a60d142-f0f6-41cc-8d84-eb9a10b1d4d5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:40.827319 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-747f9975-8ff6-4482-8adc-4d0eaaede73a tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] 10.222.0.60 "GET /compute/v2.1/servers/96617b99-e916-4aa8-a3f5-3ef4ed329f04" status: 200 len: 1502 microversion: 2.1 time: 0.358958 Dec 15 16:22:40.827875 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9a60d142-f0f6-41cc-8d84-eb9a10b1d4d5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:40.829041 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9a60d142-f0f6-41cc-8d84-eb9a10b1d4d5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:40.835705 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 140/265] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:40 2021] GET /compute/v2.1/servers/96617b99-e916-4aa8-a3f5-3ef4ed329f04 => generated 1502 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:22:40.915779 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-640a4380-f0dc-495b-88fc-7397e13e4d16 req-fe8ea08d-0f92-4db8-a19b-ae9fb68a9a6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fefd60c0-a2af-4432-9260-c3046035cb4f", "tag": "e5590de1-ee90-4501-b614-78b851657c16"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:40.918922 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:22:40.918922 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Dec 15 16:22:40.958116 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-640a4380-f0dc-495b-88fc-7397e13e4d16 req-fe8ea08d-0f92-4db8-a19b-ae9fb68a9a6f service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:40.962681 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-640a4380-f0dc-495b-88fc-7397e13e4d16 req-fe8ea08d-0f92-4db8-a19b-ae9fb68a9a6f service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:41.013178 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-640a4380-f0dc-495b-88fc-7397e13e4d16 req-fe8ea08d-0f92-4db8-a19b-ae9fb68a9a6f service nova] Creating event network-changed:e5590de1-ee90-4501-b614-78b851657c16 for instance fefd60c0-a2af-4432-9260-c3046035cb4f on hv-cinder-81268 Dec 15 16:22:41.021374 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-640a4380-f0dc-495b-88fc-7397e13e4d16 req-fe8ea08d-0f92-4db8-a19b-ae9fb68a9a6f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111953 Dec 15 16:22:41.023229 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 141/266] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:22:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:22:41.265209 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-9a60d142-f0f6-41cc-8d84-eb9a10b1d4d5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:41.287773 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-9a60d142-f0f6-41cc-8d84-eb9a10b1d4d5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1520 microversion: 2.1 time: 0.471660 Dec 15 16:22:41.287773 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 126/267] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:40 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1520 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:41.507489 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-d8422054-c8dc-4763-96f6-e2c0e4c8f262 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:41.508668 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-d8422054-c8dc-4763-96f6-e2c0e4c8f262 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: fefd60c0-a2af-4432-9260-c3046035cb4f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:41.517974 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d8422054-c8dc-4763-96f6-e2c0e4c8f262 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:41.518977 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d8422054-c8dc-4763-96f6-e2c0e4c8f262 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:41.520039 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d8422054-c8dc-4763-96f6-e2c0e4c8f262 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:41.520860 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d8422054-c8dc-4763-96f6-e2c0e4c8f262 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:41.815206 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b7d4cb01-9622-4a66-bd0c-d10349c42cd7 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:41.821374 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b7d4cb01-9622-4a66-bd0c-d10349c42cd7 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:41.838226 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b7d4cb01-9622-4a66-bd0c-d10349c42cd7 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:41.842498 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b7d4cb01-9622-4a66-bd0c-d10349c42cd7 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:41.848724 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b7d4cb01-9622-4a66-bd0c-d10349c42cd7 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:41.850107 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b7d4cb01-9622-4a66-bd0c-d10349c42cd7 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:41.893106 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-d8422054-c8dc-4763-96f6-e2c0e4c8f262 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:41.904470 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-d8422054-c8dc-4763-96f6-e2c0e4c8f262 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f" status: 200 len: 1318 microversion: 2.1 time: 0.402164 Dec 15 16:22:41.905093 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 142/268] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:41 2021] GET /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f => generated 1318 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:22:41.911441 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-4643b3a3-575a-482d-a1a4-44c1d157db36 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:41.912066 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-4643b3a3-575a-482d-a1a4-44c1d157db36 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] [instance: 96617b99-e916-4aa8-a3f5-3ef4ed329f04] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:41.930883 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4643b3a3-575a-482d-a1a4-44c1d157db36 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:41.931667 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4643b3a3-575a-482d-a1a4-44c1d157db36 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:41.938818 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4643b3a3-575a-482d-a1a4-44c1d157db36 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:41.939271 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4643b3a3-575a-482d-a1a4-44c1d157db36 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:42.038014 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b7d4cb01-9622-4a66-bd0c-d10349c42cd7 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action" status: 200 len: 28681 microversion: 2.1 time: 0.226774 Dec 15 16:22:42.055752 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 127/269] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:22:41 2021] POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action => generated 28681 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:22:42.299463 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-6b3c83c5-4886-4247-9b97-a4fd79e46722 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:42.301813 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-6b3c83c5-4886-4247-9b97-a4fd79e46722 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:42.322953 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6b3c83c5-4886-4247-9b97-a4fd79e46722 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:42.325402 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6b3c83c5-4886-4247-9b97-a4fd79e46722 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:42.326506 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6b3c83c5-4886-4247-9b97-a4fd79e46722 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:42.332549 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6b3c83c5-4886-4247-9b97-a4fd79e46722 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:42.339659 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-4643b3a3-575a-482d-a1a4-44c1d157db36 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb9f7ee83454ee38fd6d0ef1db12c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c056527e8db4053b789853fcf928010', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:42.362575 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-4643b3a3-575a-482d-a1a4-44c1d157db36 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] 10.222.0.60 "GET /compute/v2.1/servers/96617b99-e916-4aa8-a3f5-3ef4ed329f04" status: 200 len: 1502 microversion: 2.1 time: 0.455424 Dec 15 16:22:42.394991 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 143/270] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:41 2021] GET /compute/v2.1/servers/96617b99-e916-4aa8-a3f5-3ef4ed329f04 => generated 1502 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:42.938335 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-e495a69c-08fc-45e7-8fc9-23319c9a4711 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:42.944453 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-e495a69c-08fc-45e7-8fc9-23319c9a4711 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: fefd60c0-a2af-4432-9260-c3046035cb4f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:42.975856 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e495a69c-08fc-45e7-8fc9-23319c9a4711 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:42.976944 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-6b3c83c5-4886-4247-9b97-a4fd79e46722 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:42.980595 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e495a69c-08fc-45e7-8fc9-23319c9a4711 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:42.985112 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e495a69c-08fc-45e7-8fc9-23319c9a4711 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:42.987447 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e495a69c-08fc-45e7-8fc9-23319c9a4711 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:42.991198 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-6b3c83c5-4886-4247-9b97-a4fd79e46722 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1520 microversion: 2.1 time: 0.696612 Dec 15 16:22:42.991883 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 128/271] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:42 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1520 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:22:43.064005 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-8af17adb-c6cd-4ae0-9d10-8c867358e75b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:43.064977 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-8af17adb-c6cd-4ae0-9d10-8c867358e75b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:43.078507 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8af17adb-c6cd-4ae0-9d10-8c867358e75b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:43.082605 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8af17adb-c6cd-4ae0-9d10-8c867358e75b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:43.083808 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8af17adb-c6cd-4ae0-9d10-8c867358e75b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:43.084424 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8af17adb-c6cd-4ae0-9d10-8c867358e75b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:43.227392 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-8af17adb-c6cd-4ae0-9d10-8c867358e75b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action" status: 200 len: 28713 microversion: 2.1 time: 0.167499 Dec 15 16:22:43.228723 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 129/272] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:22:43 2021] POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action => generated 28713 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:22:43.395733 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-a98b7d61-9c3e-4b34-92a1-74976ff475ec tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:43.397351 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-a98b7d61-9c3e-4b34-92a1-74976ff475ec tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] [instance: 96617b99-e916-4aa8-a3f5-3ef4ed329f04] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:43.407004 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a98b7d61-9c3e-4b34-92a1-74976ff475ec tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:43.408053 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a98b7d61-9c3e-4b34-92a1-74976ff475ec tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:43.409166 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a98b7d61-9c3e-4b34-92a1-74976ff475ec tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:43.409833 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a98b7d61-9c3e-4b34-92a1-74976ff475ec tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:43.432126 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-e495a69c-08fc-45e7-8fc9-23319c9a4711 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:43.444934 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-e495a69c-08fc-45e7-8fc9-23319c9a4711 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f" status: 200 len: 1318 microversion: 2.1 time: 0.516282 Dec 15 16:22:43.447522 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 144/273] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:42 2021] GET /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f => generated 1318 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:22:43.752776 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-a98b7d61-9c3e-4b34-92a1-74976ff475ec tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb9f7ee83454ee38fd6d0ef1db12c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c056527e8db4053b789853fcf928010', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:43.761998 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-a98b7d61-9c3e-4b34-92a1-74976ff475ec tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] 10.222.0.60 "GET /compute/v2.1/servers/96617b99-e916-4aa8-a3f5-3ef4ed329f04" status: 200 len: 1502 microversion: 2.1 time: 0.371495 Dec 15 16:22:43.767741 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 130/274] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:43 2021] GET /compute/v2.1/servers/96617b99-e916-4aa8-a3f5-3ef4ed329f04 => generated 1502 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:22:44.012107 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-84d55075-15b7-4689-a29b-c00239dc0951 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:44.013384 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-84d55075-15b7-4689-a29b-c00239dc0951 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:44.039739 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-84d55075-15b7-4689-a29b-c00239dc0951 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:44.040494 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-84d55075-15b7-4689-a29b-c00239dc0951 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:44.045791 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-84d55075-15b7-4689-a29b-c00239dc0951 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:44.046313 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-84d55075-15b7-4689-a29b-c00239dc0951 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:44.241788 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-6dc966d1-88b8-4e0c-bd69-23b97b062d4a tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:44.245965 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-6dc966d1-88b8-4e0c-bd69-23b97b062d4a tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:44.273123 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6dc966d1-88b8-4e0c-bd69-23b97b062d4a tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:44.273898 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6dc966d1-88b8-4e0c-bd69-23b97b062d4a tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:44.275059 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6dc966d1-88b8-4e0c-bd69-23b97b062d4a tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:44.275976 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6dc966d1-88b8-4e0c-bd69-23b97b062d4a tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:44.375597 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-84d55075-15b7-4689-a29b-c00239dc0951 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:44.389301 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-84d55075-15b7-4689-a29b-c00239dc0951 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1520 microversion: 2.1 time: 0.383460 Dec 15 16:22:44.390273 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 145/275] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:44 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1520 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:44.468000 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-066fd6d3-0b8f-4f16-a778-903de9534600 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:44.470539 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-066fd6d3-0b8f-4f16-a778-903de9534600 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: fefd60c0-a2af-4432-9260-c3046035cb4f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:44.486694 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-6dc966d1-88b8-4e0c-bd69-23b97b062d4a tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action" status: 200 len: 30369 microversion: 2.1 time: 0.248590 Dec 15 16:22:44.488070 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 131/276] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:22:44 2021] POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action => generated 30369 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:22:44.491059 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-066fd6d3-0b8f-4f16-a778-903de9534600 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:44.493308 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-066fd6d3-0b8f-4f16-a778-903de9534600 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:44.509262 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-066fd6d3-0b8f-4f16-a778-903de9534600 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:44.523230 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-066fd6d3-0b8f-4f16-a778-903de9534600 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:44.524966 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-d320c9ee-daff-4758-8309-9086e38d1e48 req-ac53942e-b289-4dfa-8997-0f17c182845d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96617b99-e916-4aa8-a3f5-3ef4ed329f04", "name": "network-vif-deleted", "tag": "6cf0b461-3217-430a-af34-dbc9203f9ae3"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:44.539834 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:22:44.539834 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:22:44.569222 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-d320c9ee-daff-4758-8309-9086e38d1e48 req-ac53942e-b289-4dfa-8997-0f17c182845d service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:44.573584 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-d320c9ee-daff-4758-8309-9086e38d1e48 req-ac53942e-b289-4dfa-8997-0f17c182845d service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:44.611125 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-d320c9ee-daff-4758-8309-9086e38d1e48 req-ac53942e-b289-4dfa-8997-0f17c182845d service nova] Creating event network-vif-deleted:6cf0b461-3217-430a-af34-dbc9203f9ae3 for instance 96617b99-e916-4aa8-a3f5-3ef4ed329f04 on hv-cinder-81268 Dec 15 16:22:44.624525 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-d320c9ee-daff-4758-8309-9086e38d1e48 req-ac53942e-b289-4dfa-8997-0f17c182845d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107525 Dec 15 16:22:44.629334 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 132/277] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:22:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:22:44.789718 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ab226941-9493-4748-97c3-dbf5820e5ba6 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:44.795206 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ab226941-9493-4748-97c3-dbf5820e5ba6 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] [instance: 96617b99-e916-4aa8-a3f5-3ef4ed329f04] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:44.840272 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ab226941-9493-4748-97c3-dbf5820e5ba6 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:44.843078 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ab226941-9493-4748-97c3-dbf5820e5ba6 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:44.850999 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ab226941-9493-4748-97c3-dbf5820e5ba6 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:44.856109 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ab226941-9493-4748-97c3-dbf5820e5ba6 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:45.004671 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ab226941-9493-4748-97c3-dbf5820e5ba6 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:45.006371 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ab226941-9493-4748-97c3-dbf5820e5ba6 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:45.007151 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.objects.instance [None req-ab226941-9493-4748-97c3-dbf5820e5ba6 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lazy-loading 'fault' on Instance uuid 96617b99-e916-4aa8-a3f5-3ef4ed329f04 {{(pid=116084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:22:45.694165 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ab226941-9493-4748-97c3-dbf5820e5ba6 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bb9f7ee83454ee38fd6d0ef1db12c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c056527e8db4053b789853fcf928010', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:45.740794 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ab226941-9493-4748-97c3-dbf5820e5ba6 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] 10.222.0.60 "GET /compute/v2.1/servers/96617b99-e916-4aa8-a3f5-3ef4ed329f04" status: 200 len: 1303 microversion: 2.1 time: 0.956262 Dec 15 16:22:45.748604 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 133/278] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:44 2021] GET /compute/v2.1/servers/96617b99-e916-4aa8-a3f5-3ef4ed329f04 => generated 1303 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:45.782693 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-637ad7c8-1110-42ab-b503-cd3b75cdd7be tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:45.784832 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-637ad7c8-1110-42ab-b503-cd3b75cdd7be tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:45.810858 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-637ad7c8-1110-42ab-b503-cd3b75cdd7be tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:45.810858 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-637ad7c8-1110-42ab-b503-cd3b75cdd7be tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:45.810858 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-637ad7c8-1110-42ab-b503-cd3b75cdd7be tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:45.810858 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-637ad7c8-1110-42ab-b503-cd3b75cdd7be tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:45.954239 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-066fd6d3-0b8f-4f16-a778-903de9534600 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:45.994939 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-066fd6d3-0b8f-4f16-a778-903de9534600 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f" status: 200 len: 1318 microversion: 2.1 time: 1.532933 Dec 15 16:22:45.997618 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 146/279] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:44 2021] GET /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f => generated 1318 bytes in 1536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:46.006689 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-2d64b529-d0fb-4c02-b52a-9cd3fba1d4bd tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:46.023489 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-2d64b529-d0fb-4c02-b52a-9cd3fba1d4bd tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:46.043927 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2d64b529-d0fb-4c02-b52a-9cd3fba1d4bd tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:46.052171 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2d64b529-d0fb-4c02-b52a-9cd3fba1d4bd tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:46.053902 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2d64b529-d0fb-4c02-b52a-9cd3fba1d4bd tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:46.054917 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2d64b529-d0fb-4c02-b52a-9cd3fba1d4bd tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:46.265017 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-2d64b529-d0fb-4c02-b52a-9cd3fba1d4bd tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action" status: 200 len: 32300 microversion: 2.1 time: 0.265109 Dec 15 16:22:46.266492 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 147/280] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:22:45 2021] POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action => generated 32300 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:22:46.632602 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-637ad7c8-1110-42ab-b503-cd3b75cdd7be tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:46.675861 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-637ad7c8-1110-42ab-b503-cd3b75cdd7be tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1520 microversion: 2.1 time: 0.915561 Dec 15 16:22:46.676875 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 134/281] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:45 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1520 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:46.781656 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-82f0f6c1-7b9f-4db4-a7d2-ba9029584581 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:46.782374 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-82f0f6c1-7b9f-4db4-a7d2-ba9029584581 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] [instance: 96617b99-e916-4aa8-a3f5-3ef4ed329f04] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:46.793151 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-82f0f6c1-7b9f-4db4-a7d2-ba9029584581 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:46.793985 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-82f0f6c1-7b9f-4db4-a7d2-ba9029584581 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:46.795079 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-82f0f6c1-7b9f-4db4-a7d2-ba9029584581 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:46.795794 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-82f0f6c1-7b9f-4db4-a7d2-ba9029584581 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:46.824452 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.wsgi [None req-82f0f6c1-7b9f-4db4-a7d2-ba9029584581 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] HTTP exception thrown: Instance 96617b99-e916-4aa8-a3f5-3ef4ed329f04 could not be found. Dec 15 16:22:46.825109 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-82f0f6c1-7b9f-4db4-a7d2-ba9029584581 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] Returning 404 to user: Instance 96617b99-e916-4aa8-a3f5-3ef4ed329f04 could not be found. {{(pid=116085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:22:46.825987 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-82f0f6c1-7b9f-4db4-a7d2-ba9029584581 tempest-VolumesActionsTest-1283843163 tempest-VolumesActionsTest-1283843163-project] 10.222.0.60 "GET /compute/v2.1/servers/96617b99-e916-4aa8-a3f5-3ef4ed329f04" status: 404 len: 111 microversion: 2.1 time: 0.050192 Dec 15 16:22:46.832861 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 148/282] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:46 2021] GET /compute/v2.1/servers/96617b99-e916-4aa8-a3f5-3ef4ed329f04 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:22:47.029004 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-95ae1f57-6f5b-4313-80cd-b80f8a4dcafa tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:47.032285 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-95ae1f57-6f5b-4313-80cd-b80f8a4dcafa tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: fefd60c0-a2af-4432-9260-c3046035cb4f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:47.074747 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-95ae1f57-6f5b-4313-80cd-b80f8a4dcafa tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:47.076272 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-95ae1f57-6f5b-4313-80cd-b80f8a4dcafa tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:47.079928 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-95ae1f57-6f5b-4313-80cd-b80f8a4dcafa tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:47.081195 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-95ae1f57-6f5b-4313-80cd-b80f8a4dcafa tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:47.279890 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-2454c368-07f1-4067-bf04-395161426fa7 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:47.282106 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-2454c368-07f1-4067-bf04-395161426fa7 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:47.300117 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2454c368-07f1-4067-bf04-395161426fa7 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:47.300858 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2454c368-07f1-4067-bf04-395161426fa7 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:47.303776 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2454c368-07f1-4067-bf04-395161426fa7 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:47.304520 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2454c368-07f1-4067-bf04-395161426fa7 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:47.432612 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-2454c368-07f1-4067-bf04-395161426fa7 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action" status: 200 len: 33233 microversion: 2.1 time: 0.156895 Dec 15 16:22:47.438935 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 149/283] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:22:47 2021] POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action => generated 33233 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:22:47.719323 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-780e598c-5fc1-4793-98be-dfeed8951273 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:47.719323 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-780e598c-5fc1-4793-98be-dfeed8951273 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:47.750383 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-780e598c-5fc1-4793-98be-dfeed8951273 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:47.751120 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-780e598c-5fc1-4793-98be-dfeed8951273 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:47.752412 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-780e598c-5fc1-4793-98be-dfeed8951273 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:47.753206 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-780e598c-5fc1-4793-98be-dfeed8951273 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:48.032197 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-95ae1f57-6f5b-4313-80cd-b80f8a4dcafa tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:48.054366 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-95ae1f57-6f5b-4313-80cd-b80f8a4dcafa tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f" status: 200 len: 1318 microversion: 2.1 time: 1.034238 Dec 15 16:22:48.060402 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 135/284] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:47 2021] GET /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f => generated 1318 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:48.456732 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-bca5c838-d5b9-4e41-83a6-70024d16d799 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:48.465224 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-bca5c838-d5b9-4e41-83a6-70024d16d799 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:48.479248 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-780e598c-5fc1-4793-98be-dfeed8951273 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:48.496493 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bca5c838-d5b9-4e41-83a6-70024d16d799 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:48.501644 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bca5c838-d5b9-4e41-83a6-70024d16d799 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:48.504009 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bca5c838-d5b9-4e41-83a6-70024d16d799 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:48.506212 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bca5c838-d5b9-4e41-83a6-70024d16d799 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:48.506877 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-780e598c-5fc1-4793-98be-dfeed8951273 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1520 microversion: 2.1 time: 0.806919 Dec 15 16:22:48.522629 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 150/285] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:47 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1520 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:48.620334 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-bca5c838-d5b9-4e41-83a6-70024d16d799 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action" status: 200 len: 33946 microversion: 2.1 time: 0.176425 Dec 15 16:22:48.621772 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 136/286] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:22:48 2021] POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action => generated 33946 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:22:49.087932 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-35c19405-2792-4a09-b012-a2af2a847a5a tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:49.089033 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-35c19405-2792-4a09-b012-a2af2a847a5a tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: fefd60c0-a2af-4432-9260-c3046035cb4f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:49.107683 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-35c19405-2792-4a09-b012-a2af2a847a5a tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:49.110500 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-35c19405-2792-4a09-b012-a2af2a847a5a tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:49.113463 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-35c19405-2792-4a09-b012-a2af2a847a5a tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:49.114148 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-35c19405-2792-4a09-b012-a2af2a847a5a tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:49.540089 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-cb4f4663-e633-45aa-9dc8-6b8cce70dcfa tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:49.553953 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-cb4f4663-e633-45aa-9dc8-6b8cce70dcfa tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:49.600802 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cb4f4663-e633-45aa-9dc8-6b8cce70dcfa tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:49.606116 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cb4f4663-e633-45aa-9dc8-6b8cce70dcfa tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:49.610284 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cb4f4663-e633-45aa-9dc8-6b8cce70dcfa tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:49.613470 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cb4f4663-e633-45aa-9dc8-6b8cce70dcfa tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:50.486171 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-35c19405-2792-4a09-b012-a2af2a847a5a tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:50.507811 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-35c19405-2792-4a09-b012-a2af2a847a5a tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f" status: 200 len: 1318 microversion: 2.1 time: 1.424498 Dec 15 16:22:50.518680 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 151/287] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:49 2021] GET /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f => generated 1318 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:50.524619 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-1dd98ca4-7e7f-4494-afc2-0d8ea817a792 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:50.528767 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-1dd98ca4-7e7f-4494-afc2-0d8ea817a792 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:50.547649 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1dd98ca4-7e7f-4494-afc2-0d8ea817a792 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:50.550957 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1dd98ca4-7e7f-4494-afc2-0d8ea817a792 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:50.552061 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1dd98ca4-7e7f-4494-afc2-0d8ea817a792 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:50.555266 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1dd98ca4-7e7f-4494-afc2-0d8ea817a792 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:50.753764 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-cb4f4663-e633-45aa-9dc8-6b8cce70dcfa tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:50.817931 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-cb4f4663-e633-45aa-9dc8-6b8cce70dcfa tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1520 microversion: 2.1 time: 1.288190 Dec 15 16:22:50.835144 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 137/288] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:49 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1520 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:50.857698 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-3ae8b53f-9dbe-481a-bf0c-794c71df8897 req-a4332d83-1f88-42b4-9c0c-08c5e6c13313 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fefd60c0-a2af-4432-9260-c3046035cb4f", "name": "network-vif-plugged", "status": "completed", "tag": "e5590de1-ee90-4501-b614-78b851657c16"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:50.863265 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:22:50.863265 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:22:50.876215 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-3ae8b53f-9dbe-481a-bf0c-794c71df8897 req-a4332d83-1f88-42b4-9c0c-08c5e6c13313 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:50.876901 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-3ae8b53f-9dbe-481a-bf0c-794c71df8897 req-a4332d83-1f88-42b4-9c0c-08c5e6c13313 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:50.893679 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-3ae8b53f-9dbe-481a-bf0c-794c71df8897 req-a4332d83-1f88-42b4-9c0c-08c5e6c13313 service nova] Creating event network-vif-plugged:e5590de1-ee90-4501-b614-78b851657c16 for instance fefd60c0-a2af-4432-9260-c3046035cb4f on hv-cinder-81268 Dec 15 16:22:50.900984 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-3ae8b53f-9dbe-481a-bf0c-794c71df8897 req-a4332d83-1f88-42b4-9c0c-08c5e6c13313 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063534 Dec 15 16:22:50.902480 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 138/289] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:22:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:22:51.526890 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-4cf123bc-9f3a-4879-a0fb-852d29c00129 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:51.527978 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-4cf123bc-9f3a-4879-a0fb-852d29c00129 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: fefd60c0-a2af-4432-9260-c3046035cb4f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:51.542455 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4cf123bc-9f3a-4879-a0fb-852d29c00129 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:51.542969 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4cf123bc-9f3a-4879-a0fb-852d29c00129 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:51.545764 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4cf123bc-9f3a-4879-a0fb-852d29c00129 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:51.548067 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4cf123bc-9f3a-4879-a0fb-852d29c00129 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:52.245758 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-4cf123bc-9f3a-4879-a0fb-852d29c00129 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:52.272783 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-4cf123bc-9f3a-4879-a0fb-852d29c00129 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f" status: 200 len: 1318 microversion: 2.1 time: 0.749888 Dec 15 16:22:52.274257 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 139/290] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:51 2021] GET /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f => generated 1318 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:52.292962 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1a3dd99e-4ab9-4270-a393-251189074e8f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:52.298470 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1a3dd99e-4ab9-4270-a393-251189074e8f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:52.317048 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1a3dd99e-4ab9-4270-a393-251189074e8f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:52.321638 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1a3dd99e-4ab9-4270-a393-251189074e8f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:52.323769 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1a3dd99e-4ab9-4270-a393-251189074e8f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:52.324994 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1a3dd99e-4ab9-4270-a393-251189074e8f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:52.759610 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-1dd98ca4-7e7f-4494-afc2-0d8ea817a792 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action" status: 200 len: 36525 microversion: 2.1 time: 2.239229 Dec 15 16:22:52.764998 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 152/291] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:22:50 2021] POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action => generated 36525 bytes in 2245 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:22:52.920644 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1a3dd99e-4ab9-4270-a393-251189074e8f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:52.964299 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1a3dd99e-4ab9-4270-a393-251189074e8f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1520 microversion: 2.1 time: 0.677705 Dec 15 16:22:52.989326 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 140/292] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:52 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1520 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:53.292989 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-f4f47efc-9221-46ba-bb90-d035461dbc59 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:53.295184 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-f4f47efc-9221-46ba-bb90-d035461dbc59 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: fefd60c0-a2af-4432-9260-c3046035cb4f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:53.337954 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f4f47efc-9221-46ba-bb90-d035461dbc59 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:53.338886 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f4f47efc-9221-46ba-bb90-d035461dbc59 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:53.339957 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f4f47efc-9221-46ba-bb90-d035461dbc59 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:53.340567 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f4f47efc-9221-46ba-bb90-d035461dbc59 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:53.795914 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-a97b5d08-e99a-46ee-81e6-e2e1d3821af9 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:53.814287 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-a97b5d08-e99a-46ee-81e6-e2e1d3821af9 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:53.879616 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a97b5d08-e99a-46ee-81e6-e2e1d3821af9 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:53.882499 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a97b5d08-e99a-46ee-81e6-e2e1d3821af9 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:53.884574 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a97b5d08-e99a-46ee-81e6-e2e1d3821af9 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:53.896437 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a97b5d08-e99a-46ee-81e6-e2e1d3821af9 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:54.145130 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-a97b5d08-e99a-46ee-81e6-e2e1d3821af9 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action" status: 200 len: 37408 microversion: 2.1 time: 0.371103 Dec 15 16:22:54.150527 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 141/293] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:22:53 2021] POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action => generated 37408 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:22:54.157204 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-314ed0d8-fc2d-49ac-a292-e6b2c0a4e500 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:54.161771 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-314ed0d8-fc2d-49ac-a292-e6b2c0a4e500 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:54.184654 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-314ed0d8-fc2d-49ac-a292-e6b2c0a4e500 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:54.191410 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-314ed0d8-fc2d-49ac-a292-e6b2c0a4e500 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:54.196065 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-314ed0d8-fc2d-49ac-a292-e6b2c0a4e500 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:54.196960 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-314ed0d8-fc2d-49ac-a292-e6b2c0a4e500 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:54.332106 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-f4f47efc-9221-46ba-bb90-d035461dbc59 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:54.358836 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-f4f47efc-9221-46ba-bb90-d035461dbc59 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f" status: 200 len: 1318 microversion: 2.1 time: 1.063973 Dec 15 16:22:54.365091 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 153/294] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:53 2021] GET /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f => generated 1318 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:22:55.137878 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-314ed0d8-fc2d-49ac-a292-e6b2c0a4e500 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:55.180190 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-078e0362-0746-4fa6-a602-947303bddea0 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:55.180663 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-314ed0d8-fc2d-49ac-a292-e6b2c0a4e500 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1520 microversion: 2.1 time: 1.027754 Dec 15 16:22:55.193522 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 142/295] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:54 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1520 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:55.216045 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-078e0362-0746-4fa6-a602-947303bddea0 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:55.248760 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-078e0362-0746-4fa6-a602-947303bddea0 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:55.249534 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-078e0362-0746-4fa6-a602-947303bddea0 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:55.252619 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-078e0362-0746-4fa6-a602-947303bddea0 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:55.255052 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-078e0362-0746-4fa6-a602-947303bddea0 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:55.411064 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-99373f15-4e5e-4801-9450-cdd868bc0a02 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:55.423044 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-99373f15-4e5e-4801-9450-cdd868bc0a02 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: fefd60c0-a2af-4432-9260-c3046035cb4f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:55.426944 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-078e0362-0746-4fa6-a602-947303bddea0 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action" status: 200 len: 38110 microversion: 2.1 time: 0.268084 Dec 15 16:22:55.428072 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 154/296] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:22:55 2021] POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action => generated 38110 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:22:55.454769 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-99373f15-4e5e-4801-9450-cdd868bc0a02 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:55.458071 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-99373f15-4e5e-4801-9450-cdd868bc0a02 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:55.460038 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-99373f15-4e5e-4801-9450-cdd868bc0a02 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:55.460870 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-99373f15-4e5e-4801-9450-cdd868bc0a02 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:56.052081 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-99373f15-4e5e-4801-9450-cdd868bc0a02 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:56.065907 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-99373f15-4e5e-4801-9450-cdd868bc0a02 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f" status: 200 len: 1507 microversion: 2.1 time: 0.674375 Dec 15 16:22:56.070390 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 143/297] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:55 2021] GET /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f => generated 1507 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:22:56.214797 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-32dc1af3-140f-4e96-9bb0-b5cb63c213ac tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:56.216243 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-32dc1af3-140f-4e96-9bb0-b5cb63c213ac tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:56.252266 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-32dc1af3-140f-4e96-9bb0-b5cb63c213ac tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:56.267707 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-32dc1af3-140f-4e96-9bb0-b5cb63c213ac tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:56.277402 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-32dc1af3-140f-4e96-9bb0-b5cb63c213ac tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:56.278732 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-32dc1af3-140f-4e96-9bb0-b5cb63c213ac tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:56.450925 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e0246ed6-c343-425f-8876-6a78015c185b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:56.462810 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e0246ed6-c343-425f-8876-6a78015c185b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:56.538130 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e0246ed6-c343-425f-8876-6a78015c185b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:56.547289 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e0246ed6-c343-425f-8876-6a78015c185b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:56.583971 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e0246ed6-c343-425f-8876-6a78015c185b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:56.585628 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e0246ed6-c343-425f-8876-6a78015c185b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:56.809345 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e0246ed6-c343-425f-8876-6a78015c185b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action" status: 200 len: 38192 microversion: 2.1 time: 0.368640 Dec 15 16:22:56.816367 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 144/298] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:22:56 2021] POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action => generated 38192 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:22:57.037419 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-32dc1af3-140f-4e96-9bb0-b5cb63c213ac tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:57.076099 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-32dc1af3-140f-4e96-9bb0-b5cb63c213ac tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1520 microversion: 2.1 time: 0.868761 Dec 15 16:22:57.078913 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 155/299] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:56 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1520 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:22:57.832259 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b4028a90-4d16-4506-9ddf-19754119219a tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:57.834504 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b4028a90-4d16-4506-9ddf-19754119219a tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:57.877294 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b4028a90-4d16-4506-9ddf-19754119219a tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:57.884257 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b4028a90-4d16-4506-9ddf-19754119219a tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:57.903898 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b4028a90-4d16-4506-9ddf-19754119219a tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:57.910642 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b4028a90-4d16-4506-9ddf-19754119219a tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:58.086208 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b4028a90-4d16-4506-9ddf-19754119219a tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action" status: 200 len: 38313 microversion: 2.1 time: 0.263915 Dec 15 16:22:58.096825 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 145/300] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:22:57 2021] POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action => generated 38313 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:22:58.115792 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-eb19d83f-b059-4d10-87a1-c27c35466041 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:58.118816 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-eb19d83f-b059-4d10-87a1-c27c35466041 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:58.150622 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b0a7a338-0d2b-4b6c-a766-f9bcaa72b690 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:22:58.152579 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b0a7a338-0d2b-4b6c-a766-f9bcaa72b690 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:58.157684 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-eb19d83f-b059-4d10-87a1-c27c35466041 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:58.159130 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-eb19d83f-b059-4d10-87a1-c27c35466041 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:58.167624 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-eb19d83f-b059-4d10-87a1-c27c35466041 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:58.168702 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-eb19d83f-b059-4d10-87a1-c27c35466041 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:58.196220 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b0a7a338-0d2b-4b6c-a766-f9bcaa72b690 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:58.211309 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b0a7a338-0d2b-4b6c-a766-f9bcaa72b690 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:58.221696 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b0a7a338-0d2b-4b6c-a766-f9bcaa72b690 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:58.226012 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b0a7a338-0d2b-4b6c-a766-f9bcaa72b690 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:58.476533 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b0a7a338-0d2b-4b6c-a766-f9bcaa72b690 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/ips" status: 200 len: 146 microversion: 2.1 time: 0.348884 Dec 15 16:22:58.483748 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 146/301] 10.222.0.60 () {58 vars in 1247 bytes} [Wed Dec 15 16:22:58 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/ips => generated 146 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:22:58.921963 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-9c02639f-44c6-460a-aeb4-1fd0054e3014 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bde8acd6-4cb5-4837-9ac6-1725de9ac5a0"}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:22:58.938066 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-9c02639f-44c6-460a-aeb4-1fd0054e3014 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: fefd60c0-a2af-4432-9260-c3046035cb4f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:22:59.035121 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9c02639f-44c6-460a-aeb4-1fd0054e3014 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:59.044806 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9c02639f-44c6-460a-aeb4-1fd0054e3014 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:59.057368 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9c02639f-44c6-460a-aeb4-1fd0054e3014 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:22:59.068621 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9c02639f-44c6-460a-aeb4-1fd0054e3014 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:22:59.460414 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-eb19d83f-b059-4d10-87a1-c27c35466041 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:22:59.484324 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-eb19d83f-b059-4d10-87a1-c27c35466041 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1520 microversion: 2.1 time: 1.381958 Dec 15 16:22:59.486903 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 156/302] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:22:58 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1520 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:00.185323 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-9c02639f-44c6-460a-aeb4-1fd0054e3014 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "POST /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.269170 Dec 15 16:23:00.202484 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 147/303] 10.222.0.60 () {60 vars in 1322 bytes} [Wed Dec 15 16:22:58 2021] POST /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f/os-volume_attachments => generated 194 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:23:00.514897 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-f7664a58-14c0-42e3-81dd-e31918f9b4da tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:00.517306 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-f7664a58-14c0-42e3-81dd-e31918f9b4da tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:00.538214 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f7664a58-14c0-42e3-81dd-e31918f9b4da tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:00.539928 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f7664a58-14c0-42e3-81dd-e31918f9b4da tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:00.543275 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f7664a58-14c0-42e3-81dd-e31918f9b4da tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:00.545315 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f7664a58-14c0-42e3-81dd-e31918f9b4da tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:01.299251 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-f7664a58-14c0-42e3-81dd-e31918f9b4da tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:01.322096 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-f7664a58-14c0-42e3-81dd-e31918f9b4da tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1520 microversion: 2.1 time: 0.805884 Dec 15 16:23:01.333141 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 157/304] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:00 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1520 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:23:01.943943 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-cd29a6fb-2212-4414-b8ef-6a06345dee4b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a6deef8-82f0-4338-b702-d09befa93e45"}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:01.952421 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-cd29a6fb-2212-4414-b8ef-6a06345dee4b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:02.004989 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cd29a6fb-2212-4414-b8ef-6a06345dee4b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:02.010673 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cd29a6fb-2212-4414-b8ef-6a06345dee4b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:02.017564 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cd29a6fb-2212-4414-b8ef-6a06345dee4b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:02.020317 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cd29a6fb-2212-4414-b8ef-6a06345dee4b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:02.364898 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-5ea9c7a5-584c-4076-ab31-63b7b0d8bb58 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:02.365563 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-5ea9c7a5-584c-4076-ab31-63b7b0d8bb58 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:02.411063 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5ea9c7a5-584c-4076-ab31-63b7b0d8bb58 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:02.416463 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5ea9c7a5-584c-4076-ab31-63b7b0d8bb58 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:02.430345 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5ea9c7a5-584c-4076-ab31-63b7b0d8bb58 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:02.431965 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5ea9c7a5-584c-4076-ab31-63b7b0d8bb58 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:02.954102 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-cd29a6fb-2212-4414-b8ef-6a06345dee4b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.013352 Dec 15 16:23:02.963625 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 148/305] 10.222.0.60 () {60 vars in 1322 bytes} [Wed Dec 15 16:23:01 2021] POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/os-volume_attachments => generated 194 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:23:03.279053 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-5ea9c7a5-584c-4076-ab31-63b7b0d8bb58 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:03.295310 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-5ea9c7a5-584c-4076-ab31-63b7b0d8bb58 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1520 microversion: 2.1 time: 0.949022 Dec 15 16:23:03.309748 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 158/306] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:02 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1520 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:04.316138 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f2ba55ad-9f6a-4cfc-85c6-4294c8a0b2ba tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:04.317741 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f2ba55ad-9f6a-4cfc-85c6-4294c8a0b2ba tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:04.358358 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f2ba55ad-9f6a-4cfc-85c6-4294c8a0b2ba tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:04.363291 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f2ba55ad-9f6a-4cfc-85c6-4294c8a0b2ba tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:04.366534 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f2ba55ad-9f6a-4cfc-85c6-4294c8a0b2ba tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:04.368279 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f2ba55ad-9f6a-4cfc-85c6-4294c8a0b2ba tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:05.403483 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f2ba55ad-9f6a-4cfc-85c6-4294c8a0b2ba tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:05.414091 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f2ba55ad-9f6a-4cfc-85c6-4294c8a0b2ba tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1520 microversion: 2.1 time: 1.101744 Dec 15 16:23:05.415411 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 149/307] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:04 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1520 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:06.442656 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-3765b02b-43b5-4755-9b06-f74d1b7816ce tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:06.444069 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-3765b02b-43b5-4755-9b06-f74d1b7816ce tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:06.457124 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3765b02b-43b5-4755-9b06-f74d1b7816ce tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:06.460207 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3765b02b-43b5-4755-9b06-f74d1b7816ce tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:06.461438 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3765b02b-43b5-4755-9b06-f74d1b7816ce tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:06.462158 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3765b02b-43b5-4755-9b06-f74d1b7816ce tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:07.689877 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-3765b02b-43b5-4755-9b06-f74d1b7816ce tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:07.704825 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-3765b02b-43b5-4755-9b06-f74d1b7816ce tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1520 microversion: 2.1 time: 1.266052 Dec 15 16:23:07.705441 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 159/308] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:06 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1520 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:23:08.729610 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-617fc6ba-e431-4d2a-b32b-dd57a4593f6e tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:08.752377 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-617fc6ba-e431-4d2a-b32b-dd57a4593f6e tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:08.799495 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-617fc6ba-e431-4d2a-b32b-dd57a4593f6e tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:08.806917 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-617fc6ba-e431-4d2a-b32b-dd57a4593f6e tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:08.812830 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-617fc6ba-e431-4d2a-b32b-dd57a4593f6e tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:08.820857 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-617fc6ba-e431-4d2a-b32b-dd57a4593f6e tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:09.509277 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-295e7ca5-d8a6-46e8-870d-b0ced83e9dc0 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bde8acd6-4cb5-4837-9ac6-1725de9ac5a0"}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:09.511304 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-295e7ca5-d8a6-46e8-870d-b0ced83e9dc0 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: fefd60c0-a2af-4432-9260-c3046035cb4f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:09.604096 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-295e7ca5-d8a6-46e8-870d-b0ced83e9dc0 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:09.618918 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-295e7ca5-d8a6-46e8-870d-b0ced83e9dc0 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:09.636328 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-295e7ca5-d8a6-46e8-870d-b0ced83e9dc0 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:09.643334 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-295e7ca5-d8a6-46e8-870d-b0ced83e9dc0 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:09.733683 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-617fc6ba-e431-4d2a-b32b-dd57a4593f6e tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:09.803900 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-617fc6ba-e431-4d2a-b32b-dd57a4593f6e tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1500 microversion: 2.1 time: 1.081912 Dec 15 16:23:09.810014 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 150/309] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:08 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1500 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:09.854139 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c97e3f21-9d42-4e01-8f4d-11565ec41392 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f9dba7c-c2e4-489f-b3d7-d43a85baa442"}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:09.857604 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c97e3f21-9d42-4e01-8f4d-11565ec41392 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:09.877212 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c97e3f21-9d42-4e01-8f4d-11565ec41392 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:09.878007 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c97e3f21-9d42-4e01-8f4d-11565ec41392 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:09.880202 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c97e3f21-9d42-4e01-8f4d-11565ec41392 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:09.880898 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c97e3f21-9d42-4e01-8f4d-11565ec41392 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:09.950391 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-c97e3f21-9d42-4e01-8f4d-11565ec41392 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] HTTP exception thrown: Cannot 'attach_volume' instance 129b3afd-1d85-4f6e-94c3-8e7a729ff532 while it is in vm_state rescued Dec 15 16:23:09.951100 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c97e3f21-9d42-4e01-8f4d-11565ec41392 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Returning 409 to user: Cannot 'attach_volume' instance 129b3afd-1d85-4f6e-94c3-8e7a729ff532 while it is in vm_state rescued {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:23:09.952078 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c97e3f21-9d42-4e01-8f4d-11565ec41392 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "POST /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.115260 Dec 15 16:23:09.968096 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 151/310] 10.222.0.60 () {60 vars in 1322 bytes} [Wed Dec 15 16:23:09 2021] POST /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532/os-volume_attachments => generated 152 bytes in 130 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 15 16:23:09.985970 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-41e807e7-64d1-4dfb-9cf8-f0578fc95f5a tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:09.991168 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-41e807e7-64d1-4dfb-9cf8-f0578fc95f5a tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:10.009046 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-41e807e7-64d1-4dfb-9cf8-f0578fc95f5a tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:10.014497 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-41e807e7-64d1-4dfb-9cf8-f0578fc95f5a tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:10.018574 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-41e807e7-64d1-4dfb-9cf8-f0578fc95f5a tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:10.019316 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-41e807e7-64d1-4dfb-9cf8-f0578fc95f5a tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:10.083152 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.wsgi [None req-295e7ca5-d8a6-46e8-870d-b0ced83e9dc0 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] HTTP exception thrown: Invalid volume: volume bde8acd6-4cb5-4837-9ac6-1725de9ac5a0 is already attached to instances: fefd60c0-a2af-4432-9260-c3046035cb4f Dec 15 16:23:10.093881 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-295e7ca5-d8a6-46e8-870d-b0ced83e9dc0 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Returning 400 to user: Invalid volume: volume bde8acd6-4cb5-4837-9ac6-1725de9ac5a0 is already attached to instances: fefd60c0-a2af-4432-9260-c3046035cb4f {{(pid=116085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:23:10.099989 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-295e7ca5-d8a6-46e8-870d-b0ced83e9dc0 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "POST /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.597096 Dec 15 16:23:10.109887 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 160/311] 10.222.0.60 () {60 vars in 1322 bytes} [Wed Dec 15 16:23:09 2021] POST /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f/os-volume_attachments => generated 174 bytes in 610 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 15 16:23:10.276452 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-35e26fc9-ce5b-4ce9-b5a5-7e2c8431d703 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:10.278294 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-35e26fc9-ce5b-4ce9-b5a5-7e2c8431d703 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: fefd60c0-a2af-4432-9260-c3046035cb4f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:10.307890 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-35e26fc9-ce5b-4ce9-b5a5-7e2c8431d703 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:10.309374 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-35e26fc9-ce5b-4ce9-b5a5-7e2c8431d703 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:10.311180 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-35e26fc9-ce5b-4ce9-b5a5-7e2c8431d703 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:10.312732 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-35e26fc9-ce5b-4ce9-b5a5-7e2c8431d703 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:10.344886 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-41e807e7-64d1-4dfb-9cf8-f0578fc95f5a tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "POST /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532/action" status: 202 len: 0 microversion: 2.1 time: 0.375231 Dec 15 16:23:10.345543 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 152/312] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:23:09 2021] POST /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532/action => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:23:10.374982 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-a39157c8-a4ec-4e65-9448-9d366d6c89b3 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:10.380787 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-a39157c8-a4ec-4e65-9448-9d366d6c89b3 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:10.408431 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a39157c8-a4ec-4e65-9448-9d366d6c89b3 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:10.408894 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a39157c8-a4ec-4e65-9448-9d366d6c89b3 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:10.416726 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a39157c8-a4ec-4e65-9448-9d366d6c89b3 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:10.419624 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a39157c8-a4ec-4e65-9448-9d366d6c89b3 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:10.561551 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.objects.instance [None req-35e26fc9-ce5b-4ce9-b5a5-7e2c8431d703 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lazy-loading 'services' on Instance uuid fefd60c0-a2af-4432-9260-c3046035cb4f {{(pid=116085) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:23:10.910978 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-35e26fc9-ce5b-4ce9-b5a5-7e2c8431d703 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "DELETE /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f/os-volume_attachments/bde8acd6-4cb5-4837-9ac6-1725de9ac5a0" status: 202 len: 0 microversion: 2.1 time: 0.641189 Dec 15 16:23:10.935501 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 161/313] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Dec 15 16:23:10 2021] DELETE /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f/os-volume_attachments/bde8acd6-4cb5-4837-9ac6-1725de9ac5a0 => generated 0 bytes in 667 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:23:10.966291 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-2cdd290c-a595-49da-ab08-48d2159477ab tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:10.969564 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-2cdd290c-a595-49da-ab08-48d2159477ab tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: fefd60c0-a2af-4432-9260-c3046035cb4f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:10.996934 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2cdd290c-a595-49da-ab08-48d2159477ab tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:11.012379 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2cdd290c-a595-49da-ab08-48d2159477ab tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:11.018572 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2cdd290c-a595-49da-ab08-48d2159477ab tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:11.022258 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2cdd290c-a595-49da-ab08-48d2159477ab tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:11.098548 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-a39157c8-a4ec-4e65-9448-9d366d6c89b3 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:11.118426 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-a39157c8-a4ec-4e65-9448-9d366d6c89b3 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1508 microversion: 2.1 time: 0.761026 Dec 15 16:23:11.122814 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 153/314] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:10 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1508 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:11.220399 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-2cdd290c-a595-49da-ab08-48d2159477ab tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.277388 Dec 15 16:23:11.233177 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 162/315] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Dec 15 16:23:10 2021] GET /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f/os-volume_attachments => generated 197 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:23:12.153742 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ec1f6b9c-9218-49d0-8a34-f809bfe9c6ca tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:12.158181 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ec1f6b9c-9218-49d0-8a34-f809bfe9c6ca tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:12.193233 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ec1f6b9c-9218-49d0-8a34-f809bfe9c6ca tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:12.194137 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ec1f6b9c-9218-49d0-8a34-f809bfe9c6ca tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:12.195972 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ec1f6b9c-9218-49d0-8a34-f809bfe9c6ca tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:12.197899 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ec1f6b9c-9218-49d0-8a34-f809bfe9c6ca tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:12.237305 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-a403b1ca-f268-46c6-ab0d-ff56c7bd9f40 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:12.238345 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-a403b1ca-f268-46c6-ab0d-ff56c7bd9f40 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: fefd60c0-a2af-4432-9260-c3046035cb4f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:12.258986 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a403b1ca-f268-46c6-ab0d-ff56c7bd9f40 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:12.259585 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a403b1ca-f268-46c6-ab0d-ff56c7bd9f40 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:12.267532 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a403b1ca-f268-46c6-ab0d-ff56c7bd9f40 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:12.268069 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a403b1ca-f268-46c6-ab0d-ff56c7bd9f40 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:12.338756 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-a403b1ca-f268-46c6-ab0d-ff56c7bd9f40 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106384 Dec 15 16:23:12.343708 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 163/316] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Dec 15 16:23:12 2021] GET /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:23:12.907198 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ec1f6b9c-9218-49d0-8a34-f809bfe9c6ca tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:12.924021 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ec1f6b9c-9218-49d0-8a34-f809bfe9c6ca tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1508 microversion: 2.1 time: 0.784167 Dec 15 16:23:12.935607 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 154/317] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:12 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1508 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:13.351401 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-1b85e886-4cdd-453b-80b8-b97f8fb177a4 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:13.352326 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-1b85e886-4cdd-453b-80b8-b97f8fb177a4 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: fefd60c0-a2af-4432-9260-c3046035cb4f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:13.379600 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1b85e886-4cdd-453b-80b8-b97f8fb177a4 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:13.386658 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1b85e886-4cdd-453b-80b8-b97f8fb177a4 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:13.388682 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1b85e886-4cdd-453b-80b8-b97f8fb177a4 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:13.392022 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1b85e886-4cdd-453b-80b8-b97f8fb177a4 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:13.523976 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-1b85e886-4cdd-453b-80b8-b97f8fb177a4 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.176431 Dec 15 16:23:13.525111 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 164/318] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Dec 15 16:23:13 2021] GET /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f/os-volume_attachments => generated 197 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:23:13.784642 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-99a44a05-854e-44c9-b3ef-3a80b19e09d1 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Action: 'create', calling method: .version_select at 0x7f0b2768a8b0>, body: {"keypair": {"name": "tempest-TestShelveInstance-663151410"}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:13.839243 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-99a44a05-854e-44c9-b3ef-3a80b19e09d1 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Getting quotas for project 60fc732badb0488392694e6d6c67d5dc. Resources: {'key_pairs'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:23:13.846385 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-99a44a05-854e-44c9-b3ef-3a80b19e09d1 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Getting quotas for user 4b554f95b7b4444ab70e9dabf8197de6 and project 60fc732badb0488392694e6d6c67d5dc. Resources: {'key_pairs'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:23:13.952485 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-fd3f3f8e-986c-4dad-909d-1f231d8afdb6 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:13.953481 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-fd3f3f8e-986c-4dad-909d-1f231d8afdb6 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:13.970731 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fd3f3f8e-986c-4dad-909d-1f231d8afdb6 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:13.971587 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fd3f3f8e-986c-4dad-909d-1f231d8afdb6 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:13.972631 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fd3f3f8e-986c-4dad-909d-1f231d8afdb6 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:13.973977 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fd3f3f8e-986c-4dad-909d-1f231d8afdb6 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:14.210150 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-99a44a05-854e-44c9-b3ef-3a80b19e09d1 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Getting quotas for project 60fc732badb0488392694e6d6c67d5dc. Resources: {'key_pairs'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:23:14.230534 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-99a44a05-854e-44c9-b3ef-3a80b19e09d1 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Getting quotas for user 4b554f95b7b4444ab70e9dabf8197de6 and project 60fc732badb0488392694e6d6c67d5dc. Resources: {'key_pairs'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:23:14.304012 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-99a44a05-854e-44c9-b3ef-3a80b19e09d1 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 2311 microversion: 2.1 time: 0.817272 Dec 15 16:23:14.326756 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 155/319] 10.222.0.60 () {60 vars in 1157 bytes} [Wed Dec 15 16:23:13 2021] POST /compute/v2.1/os-keypairs => generated 2311 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:14.397595 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-fd3f3f8e-986c-4dad-909d-1f231d8afdb6 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:14.408867 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-fd3f3f8e-986c-4dad-909d-1f231d8afdb6 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1508 microversion: 2.1 time: 0.458685 Dec 15 16:23:14.421186 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 165/320] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:13 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1508 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:14.538501 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-92f0e015-6c7f-4c50-bc73-bd9d13f21a38 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:14.539962 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-92f0e015-6c7f-4c50-bc73-bd9d13f21a38 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: fefd60c0-a2af-4432-9260-c3046035cb4f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:14.562676 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-92f0e015-6c7f-4c50-bc73-bd9d13f21a38 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:14.565889 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-92f0e015-6c7f-4c50-bc73-bd9d13f21a38 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:14.569863 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-92f0e015-6c7f-4c50-bc73-bd9d13f21a38 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:14.573696 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-92f0e015-6c7f-4c50-bc73-bd9d13f21a38 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:14.671064 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-92f0e015-6c7f-4c50-bc73-bd9d13f21a38 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137076 Dec 15 16:23:14.689886 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 156/321] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Dec 15 16:23:14 2021] GET /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:23:15.426605 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-96a86821-c2b5-46ce-b8ee-8e667ad0f31f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:15.427293 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-96a86821-c2b5-46ce-b8ee-8e667ad0f31f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:15.449817 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-96a86821-c2b5-46ce-b8ee-8e667ad0f31f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:15.450487 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-96a86821-c2b5-46ce-b8ee-8e667ad0f31f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:15.451474 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-96a86821-c2b5-46ce-b8ee-8e667ad0f31f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:15.455494 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-96a86821-c2b5-46ce-b8ee-8e667ad0f31f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:15.701978 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-3df9c459-a43e-41d3-aa46-3a8b91850b08 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:15.712527 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-3df9c459-a43e-41d3-aa46-3a8b91850b08 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: fefd60c0-a2af-4432-9260-c3046035cb4f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:15.725934 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3df9c459-a43e-41d3-aa46-3a8b91850b08 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:15.727204 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3df9c459-a43e-41d3-aa46-3a8b91850b08 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:15.737928 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3df9c459-a43e-41d3-aa46-3a8b91850b08 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:15.738914 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3df9c459-a43e-41d3-aa46-3a8b91850b08 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:15.798388 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-3df9c459-a43e-41d3-aa46-3a8b91850b08 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103570 Dec 15 16:23:15.800120 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 157/322] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Dec 15 16:23:15 2021] GET /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:23:16.015871 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-96a86821-c2b5-46ce-b8ee-8e667ad0f31f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:16.051991 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-96a86821-c2b5-46ce-b8ee-8e667ad0f31f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1508 microversion: 2.1 time: 0.628821 Dec 15 16:23:16.072648 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 166/323] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:15 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1508 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:16.298078 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f8a9a37d-f428-41dd-abfa-2ed54760c33d tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Action: 'create', calling method: .version_select at 0x7f0b275f7820>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1448152906"}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:16.387492 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-f8a9a37d-f428-41dd-abfa-2ed54760c33d tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Getting quotas for project 9fd32b6eee5e4a75b6dec0e216953bd4. Resources: {'key_pairs'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:23:16.404773 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-f8a9a37d-f428-41dd-abfa-2ed54760c33d tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Getting quotas for user c46c8a697d044c8ba9b2c0e46c70c6e8 and project 9fd32b6eee5e4a75b6dec0e216953bd4. Resources: {'key_pairs'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:23:16.817106 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-960b587a-798c-4c1d-82b6-b9fa9da5ac5c tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:16.819192 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-960b587a-798c-4c1d-82b6-b9fa9da5ac5c tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: fefd60c0-a2af-4432-9260-c3046035cb4f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:16.835805 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-960b587a-798c-4c1d-82b6-b9fa9da5ac5c tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:16.836429 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-960b587a-798c-4c1d-82b6-b9fa9da5ac5c tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:16.837388 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-960b587a-798c-4c1d-82b6-b9fa9da5ac5c tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:16.837970 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-960b587a-798c-4c1d-82b6-b9fa9da5ac5c tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:16.922959 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-960b587a-798c-4c1d-82b6-b9fa9da5ac5c tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105880 Dec 15 16:23:16.927137 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 167/324] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Dec 15 16:23:16 2021] GET /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:23:17.083680 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-6f604520-b0b6-42e6-8a4a-1741c643ea74 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:17.084825 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-6f604520-b0b6-42e6-8a4a-1741c643ea74 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:17.128980 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6f604520-b0b6-42e6-8a4a-1741c643ea74 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:17.129814 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6f604520-b0b6-42e6-8a4a-1741c643ea74 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:17.134763 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-f8a9a37d-f428-41dd-abfa-2ed54760c33d tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Getting quotas for project 9fd32b6eee5e4a75b6dec0e216953bd4. Resources: {'key_pairs'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:23:17.137288 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6f604520-b0b6-42e6-8a4a-1741c643ea74 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:17.138063 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6f604520-b0b6-42e6-8a4a-1741c643ea74 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:17.149886 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-f8a9a37d-f428-41dd-abfa-2ed54760c33d tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Getting quotas for user c46c8a697d044c8ba9b2c0e46c70c6e8 and project 9fd32b6eee5e4a75b6dec0e216953bd4. Resources: {'key_pairs'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:23:17.196232 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f8a9a37d-f428-41dd-abfa-2ed54760c33d tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 1.163127 Dec 15 16:23:17.217520 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 158/325] 10.222.0.60 () {60 vars in 1157 bytes} [Wed Dec 15 16:23:16 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:18.018168 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ddce3198-c78c-4f9a-9a30-126bade60807 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:18.023099 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ddce3198-c78c-4f9a-9a30-126bade60807 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: fefd60c0-a2af-4432-9260-c3046035cb4f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:18.107546 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-6f604520-b0b6-42e6-8a4a-1741c643ea74 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:18.172458 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-6f604520-b0b6-42e6-8a4a-1741c643ea74 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1508 microversion: 2.1 time: 1.084116 Dec 15 16:23:18.179684 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ddce3198-c78c-4f9a-9a30-126bade60807 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:18.181029 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ddce3198-c78c-4f9a-9a30-126bade60807 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:18.183543 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ddce3198-c78c-4f9a-9a30-126bade60807 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:18.184228 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ddce3198-c78c-4f9a-9a30-126bade60807 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:18.189271 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 168/326] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:17 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1508 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:23:18.312329 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ddce3198-c78c-4f9a-9a30-126bade60807 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.354635 Dec 15 16:23:18.317792 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 159/327] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Dec 15 16:23:17 2021] GET /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f/os-volume_attachments => generated 197 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:23:19.191603 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-326ce201-7933-4e61-bc0b-d23a035cdbc5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:19.193132 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-326ce201-7933-4e61-bc0b-d23a035cdbc5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:19.225396 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-326ce201-7933-4e61-bc0b-d23a035cdbc5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:19.230544 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-326ce201-7933-4e61-bc0b-d23a035cdbc5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:19.233864 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-326ce201-7933-4e61-bc0b-d23a035cdbc5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:19.235420 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-326ce201-7933-4e61-bc0b-d23a035cdbc5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:19.349800 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-6804d1fe-e7e8-4051-943c-0664a70fbf08 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:19.359031 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-6804d1fe-e7e8-4051-943c-0664a70fbf08 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: fefd60c0-a2af-4432-9260-c3046035cb4f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:19.381133 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6804d1fe-e7e8-4051-943c-0664a70fbf08 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:19.381955 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6804d1fe-e7e8-4051-943c-0664a70fbf08 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:19.389880 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6804d1fe-e7e8-4051-943c-0664a70fbf08 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:19.398549 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6804d1fe-e7e8-4051-943c-0664a70fbf08 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:19.564279 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-6804d1fe-e7e8-4051-943c-0664a70fbf08 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.238691 Dec 15 16:23:19.572603 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 160/328] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Dec 15 16:23:19 2021] GET /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f/os-volume_attachments => generated 197 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:23:19.599414 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-7a081866-5797-4d29-88a5-6715307235a6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:19.673840 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7a081866-5797-4d29-88a5-6715307235a6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:19.674653 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7a081866-5797-4d29-88a5-6715307235a6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:20.092542 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-7a081866-5797-4d29-88a5-6715307235a6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Going to try to stop instance {{(pid=116084) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 15 16:23:20.129271 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-326ce201-7933-4e61-bc0b-d23a035cdbc5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:20.153211 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-326ce201-7933-4e61-bc0b-d23a035cdbc5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1508 microversion: 2.1 time: 0.963725 Dec 15 16:23:20.157319 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 169/329] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:19 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1508 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:20.356229 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-7a081866-5797-4d29-88a5-6715307235a6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action" status: 202 len: 0 microversion: 2.1 time: 0.783002 Dec 15 16:23:20.371273 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 161/330] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:23:19 2021] POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action => generated 0 bytes in 801 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:23:20.375950 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-8d1a174a-0133-4fc6-b690-249d3d1422eb tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:20.376737 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-8d1a174a-0133-4fc6-b690-249d3d1422eb tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:20.437259 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8d1a174a-0133-4fc6-b690-249d3d1422eb tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:20.440519 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8d1a174a-0133-4fc6-b690-249d3d1422eb tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:20.441512 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8d1a174a-0133-4fc6-b690-249d3d1422eb tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:20.442078 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8d1a174a-0133-4fc6-b690-249d3d1422eb tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:20.587476 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c0a08230-8460-48d2-b7ee-75e21e9ee3cd tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:20.594255 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c0a08230-8460-48d2-b7ee-75e21e9ee3cd tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: fefd60c0-a2af-4432-9260-c3046035cb4f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:20.623053 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c0a08230-8460-48d2-b7ee-75e21e9ee3cd tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:20.648380 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c0a08230-8460-48d2-b7ee-75e21e9ee3cd tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:20.651470 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c0a08230-8460-48d2-b7ee-75e21e9ee3cd tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:20.654132 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c0a08230-8460-48d2-b7ee-75e21e9ee3cd tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:20.837754 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c0a08230-8460-48d2-b7ee-75e21e9ee3cd tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.259019 Dec 15 16:23:20.838311 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 162/331] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Dec 15 16:23:20 2021] GET /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f/os-volume_attachments => generated 25 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:23:21.109421 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-8d1a174a-0133-4fc6-b690-249d3d1422eb tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:21.167683 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-8d1a174a-0133-4fc6-b690-249d3d1422eb tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1723 microversion: 2.1 time: 0.795974 Dec 15 16:23:21.188879 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b4fe16d4-e3a8-43a2-8242-8fa90318d065 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:21.193400 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b4fe16d4-e3a8-43a2-8242-8fa90318d065 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:21.209660 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 170/332] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:20 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1723 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:21.217776 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b4fe16d4-e3a8-43a2-8242-8fa90318d065 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:21.221252 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b4fe16d4-e3a8-43a2-8242-8fa90318d065 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:21.224450 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b4fe16d4-e3a8-43a2-8242-8fa90318d065 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:21.226994 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b4fe16d4-e3a8-43a2-8242-8fa90318d065 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:21.490729 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-2b7fe0f5-abf7-430d-8bb3-4eaae1cc10c3 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-262858116", "imageRef": "b72b5f54-34d0-48ac-9484-bc8104a6dddb", "flavorRef": "452", "networks": [{"uuid": "d3a23e9e-8c1c-4ad2-af72-ef7451820760"}]}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:21.752637 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b4fe16d4-e3a8-43a2-8242-8fa90318d065 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:21.817490 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b4fe16d4-e3a8-43a2-8242-8fa90318d065 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1514 microversion: 2.1 time: 0.630850 Dec 15 16:23:21.818608 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 163/333] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:21 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1514 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:22.193658 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-966670cb-c107-4650-8b12-8b8f83f1d4e2 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:22.195121 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-966670cb-c107-4650-8b12-8b8f83f1d4e2 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:22.243671 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-966670cb-c107-4650-8b12-8b8f83f1d4e2 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:22.248406 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-966670cb-c107-4650-8b12-8b8f83f1d4e2 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:22.254246 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-966670cb-c107-4650-8b12-8b8f83f1d4e2 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:22.257354 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-966670cb-c107-4650-8b12-8b8f83f1d4e2 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:22.713636 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-966670cb-c107-4650-8b12-8b8f83f1d4e2 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:22.732210 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-966670cb-c107-4650-8b12-8b8f83f1d4e2 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1723 microversion: 2.1 time: 0.547432 Dec 15 16:23:22.733715 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 164/334] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:22 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1723 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:23.677082 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-49d8ed9f-071d-4a8a-9454-9536aad29360 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:23.677734 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-49d8ed9f-071d-4a8a-9454-9536aad29360 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:23.699179 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-49d8ed9f-071d-4a8a-9454-9536aad29360 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:23.699956 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-49d8ed9f-071d-4a8a-9454-9536aad29360 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:23.701056 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-49d8ed9f-071d-4a8a-9454-9536aad29360 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:23.703930 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-49d8ed9f-071d-4a8a-9454-9536aad29360 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:24.117352 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-49d8ed9f-071d-4a8a-9454-9536aad29360 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:24.161872 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-49d8ed9f-071d-4a8a-9454-9536aad29360 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1514 microversion: 2.1 time: 0.509650 Dec 15 16:23:24.163806 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 165/335] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:23 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1514 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:24.172017 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-5e7a84b7-1392-4478-8f30-e624efa8aeda tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:24.176034 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-5e7a84b7-1392-4478-8f30-e624efa8aeda tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:24.188914 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5e7a84b7-1392-4478-8f30-e624efa8aeda tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:24.190212 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5e7a84b7-1392-4478-8f30-e624efa8aeda tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:24.192308 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5e7a84b7-1392-4478-8f30-e624efa8aeda tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:24.193559 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5e7a84b7-1392-4478-8f30-e624efa8aeda tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:24.731442 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-5e7a84b7-1392-4478-8f30-e624efa8aeda tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:24.742355 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-5e7a84b7-1392-4478-8f30-e624efa8aeda tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1723 microversion: 2.1 time: 0.574679 Dec 15 16:23:24.747099 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 166/336] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:24 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1723 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:24.775754 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-3869e877-6d5b-4dea-9796-1251152d6eab tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63380b50-7c61-4411-a23a-7ebf8d15fb49"}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:24.777547 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-3869e877-6d5b-4dea-9796-1251152d6eab tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:24.793429 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3869e877-6d5b-4dea-9796-1251152d6eab tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:24.793879 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3869e877-6d5b-4dea-9796-1251152d6eab tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:24.797600 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3869e877-6d5b-4dea-9796-1251152d6eab tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:24.798047 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3869e877-6d5b-4dea-9796-1251152d6eab tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:27.500548 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-3869e877-6d5b-4dea-9796-1251152d6eab tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "POST /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.751707 Dec 15 16:23:27.504126 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 167/337] 10.222.0.60 () {60 vars in 1322 bytes} [Wed Dec 15 16:23:24 2021] POST /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532/os-volume_attachments => generated 194 bytes in 2756 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:23:27.534234 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-350e3f22-212d-4390-b480-90f0d656e574 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:27.537370 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-350e3f22-212d-4390-b480-90f0d656e574 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:27.566963 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-350e3f22-212d-4390-b480-90f0d656e574 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:27.568524 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-350e3f22-212d-4390-b480-90f0d656e574 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:27.571150 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-350e3f22-212d-4390-b480-90f0d656e574 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:27.572242 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-350e3f22-212d-4390-b480-90f0d656e574 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:27.980267 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-350e3f22-212d-4390-b480-90f0d656e574 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:28.010585 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-350e3f22-212d-4390-b480-90f0d656e574 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1723 microversion: 2.1 time: 0.500448 Dec 15 16:23:28.031559 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 168/338] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:27 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1723 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:29.048274 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-50d89d6c-a956-4713-bb07-2b86e79cd92a tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:29.054734 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-50d89d6c-a956-4713-bb07-2b86e79cd92a tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:29.076929 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-50d89d6c-a956-4713-bb07-2b86e79cd92a tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:29.079862 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-50d89d6c-a956-4713-bb07-2b86e79cd92a tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:29.081771 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-50d89d6c-a956-4713-bb07-2b86e79cd92a tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:29.083862 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-50d89d6c-a956-4713-bb07-2b86e79cd92a tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:29.439071 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-50d89d6c-a956-4713-bb07-2b86e79cd92a tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:29.450908 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-50d89d6c-a956-4713-bb07-2b86e79cd92a tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1723 microversion: 2.1 time: 0.417699 Dec 15 16:23:29.452010 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 169/339] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:29 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1723 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:30.475606 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-fae48d00-8b73-4166-91e7-b89c0de04377 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:30.480104 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-fae48d00-8b73-4166-91e7-b89c0de04377 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:30.512422 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fae48d00-8b73-4166-91e7-b89c0de04377 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:30.514864 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fae48d00-8b73-4166-91e7-b89c0de04377 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:30.517047 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fae48d00-8b73-4166-91e7-b89c0de04377 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:30.520161 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fae48d00-8b73-4166-91e7-b89c0de04377 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:30.771525 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-fae48d00-8b73-4166-91e7-b89c0de04377 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:30.791969 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-fae48d00-8b73-4166-91e7-b89c0de04377 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1723 microversion: 2.1 time: 0.323954 Dec 15 16:23:30.793827 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 170/340] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:30 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1723 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:31.813202 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1c8a66f6-5453-413b-a47a-19b043fd1368 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:31.814368 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1c8a66f6-5453-413b-a47a-19b043fd1368 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:31.822604 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1c8a66f6-5453-413b-a47a-19b043fd1368 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:31.822947 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1c8a66f6-5453-413b-a47a-19b043fd1368 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:31.823756 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1c8a66f6-5453-413b-a47a-19b043fd1368 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:31.824198 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1c8a66f6-5453-413b-a47a-19b043fd1368 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:32.032967 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1c8a66f6-5453-413b-a47a-19b043fd1368 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:32.059687 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1c8a66f6-5453-413b-a47a-19b043fd1368 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1723 microversion: 2.1 time: 0.251350 Dec 15 16:23:32.060882 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 171/341] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:31 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1723 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:33.089277 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-a0feab85-2da4-4a1f-8b83-dc7fdc0f9199 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:33.090323 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-a0feab85-2da4-4a1f-8b83-dc7fdc0f9199 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:33.123834 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a0feab85-2da4-4a1f-8b83-dc7fdc0f9199 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:33.124406 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a0feab85-2da4-4a1f-8b83-dc7fdc0f9199 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:33.125713 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a0feab85-2da4-4a1f-8b83-dc7fdc0f9199 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:33.126170 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a0feab85-2da4-4a1f-8b83-dc7fdc0f9199 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:33.355909 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-a0feab85-2da4-4a1f-8b83-dc7fdc0f9199 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:33.366298 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-a0feab85-2da4-4a1f-8b83-dc7fdc0f9199 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1723 microversion: 2.1 time: 0.284702 Dec 15 16:23:33.367829 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 172/342] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:33 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1723 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:23:34.387480 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-42c0c74f-3402-428d-b3dd-0d8caf5fbed6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:34.388953 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-42c0c74f-3402-428d-b3dd-0d8caf5fbed6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:34.398181 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-42c0c74f-3402-428d-b3dd-0d8caf5fbed6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:34.399121 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-42c0c74f-3402-428d-b3dd-0d8caf5fbed6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:34.404150 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-42c0c74f-3402-428d-b3dd-0d8caf5fbed6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:34.406079 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-42c0c74f-3402-428d-b3dd-0d8caf5fbed6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:34.672212 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-42c0c74f-3402-428d-b3dd-0d8caf5fbed6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:34.685174 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-42c0c74f-3402-428d-b3dd-0d8caf5fbed6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1723 microversion: 2.1 time: 0.302906 Dec 15 16:23:34.686313 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 173/343] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:34 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1723 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:35.535440 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-6bb792be-c708-4c3a-9195-f74a4377de5d tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:35.537146 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-6bb792be-c708-4c3a-9195-f74a4377de5d tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:35.549087 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6bb792be-c708-4c3a-9195-f74a4377de5d tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:35.549528 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6bb792be-c708-4c3a-9195-f74a4377de5d tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:35.550615 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6bb792be-c708-4c3a-9195-f74a4377de5d tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:35.551264 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6bb792be-c708-4c3a-9195-f74a4377de5d tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:35.584045 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.objects.instance [None req-6bb792be-c708-4c3a-9195-f74a4377de5d tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lazy-loading 'flavor' on Instance uuid 129b3afd-1d85-4f6e-94c3-8e7a729ff532 {{(pid=116084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:23:35.829388 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-6bb792be-c708-4c3a-9195-f74a4377de5d tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "POST /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532/action" status: 200 len: 32 microversion: 2.1 time: 0.303627 Dec 15 16:23:35.831283 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 174/344] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:23:35 2021] POST /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532/action => generated 32 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:23:35.837604 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-26a35e05-a755-4d3b-b9c4-556cd41e974d tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:35.838656 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-26a35e05-a755-4d3b-b9c4-556cd41e974d tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:35.846275 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-26a35e05-a755-4d3b-b9c4-556cd41e974d tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:35.846882 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-26a35e05-a755-4d3b-b9c4-556cd41e974d tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:35.848106 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-26a35e05-a755-4d3b-b9c4-556cd41e974d tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:35.848681 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-26a35e05-a755-4d3b-b9c4-556cd41e974d tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:36.102481 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-26a35e05-a755-4d3b-b9c4-556cd41e974d tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:36.117194 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-26a35e05-a755-4d3b-b9c4-556cd41e974d tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1723 microversion: 2.1 time: 0.283835 Dec 15 16:23:36.121390 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 175/345] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:35 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1723 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:36.133782 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1a1741f0-181b-43bc-a6c8-9e6b91fda975 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:36.134670 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1a1741f0-181b-43bc-a6c8-9e6b91fda975 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:36.143106 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1a1741f0-181b-43bc-a6c8-9e6b91fda975 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:36.143607 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1a1741f0-181b-43bc-a6c8-9e6b91fda975 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:36.155027 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1a1741f0-181b-43bc-a6c8-9e6b91fda975 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:36.161639 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1a1741f0-181b-43bc-a6c8-9e6b91fda975 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:36.372374 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1a1741f0-181b-43bc-a6c8-9e6b91fda975 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:36.383164 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1a1741f0-181b-43bc-a6c8-9e6b91fda975 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1566 microversion: 2.1 time: 0.260148 Dec 15 16:23:36.383794 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 176/346] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:36 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1566 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:37.137964 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-21562900-3d91-42bf-867f-1887c565a03e tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:37.139698 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-21562900-3d91-42bf-867f-1887c565a03e tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:37.147914 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-21562900-3d91-42bf-867f-1887c565a03e tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:37.148779 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-21562900-3d91-42bf-867f-1887c565a03e tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:37.150118 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-21562900-3d91-42bf-867f-1887c565a03e tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:37.150889 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-21562900-3d91-42bf-867f-1887c565a03e tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:37.356547 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-21562900-3d91-42bf-867f-1887c565a03e tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:37.368792 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-21562900-3d91-42bf-867f-1887c565a03e tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1723 microversion: 2.1 time: 0.234421 Dec 15 16:23:37.369475 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 177/347] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:37 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:23:37.403232 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-59cbf82f-b388-485e-bb9b-26bdbc12d7c1 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:37.404156 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-59cbf82f-b388-485e-bb9b-26bdbc12d7c1 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:37.413924 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-59cbf82f-b388-485e-bb9b-26bdbc12d7c1 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:37.414538 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-59cbf82f-b388-485e-bb9b-26bdbc12d7c1 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:37.415729 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-59cbf82f-b388-485e-bb9b-26bdbc12d7c1 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:37.416278 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-59cbf82f-b388-485e-bb9b-26bdbc12d7c1 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:37.600080 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-59cbf82f-b388-485e-bb9b-26bdbc12d7c1 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:37.610725 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-59cbf82f-b388-485e-bb9b-26bdbc12d7c1 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1566 microversion: 2.1 time: 0.212339 Dec 15 16:23:37.611345 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 178/348] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:37 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1566 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:23:38.394734 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f2efa8a3-aa44-42d4-a71a-d891c6bcb90f tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:38.396820 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f2efa8a3-aa44-42d4-a71a-d891c6bcb90f tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:38.410261 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f2efa8a3-aa44-42d4-a71a-d891c6bcb90f tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:38.412644 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f2efa8a3-aa44-42d4-a71a-d891c6bcb90f tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:38.414509 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f2efa8a3-aa44-42d4-a71a-d891c6bcb90f tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:38.415624 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f2efa8a3-aa44-42d4-a71a-d891c6bcb90f tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:38.663189 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f2efa8a3-aa44-42d4-a71a-d891c6bcb90f tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:38.716962 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f2efa8a3-aa44-42d4-a71a-d891c6bcb90f tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1723 microversion: 2.1 time: 0.327240 Dec 15 16:23:38.731714 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 179/349] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:38 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1723 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:38.741009 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-8d3e8e0f-b2b6-4c7b-8a76-c7f7876f048f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:38.742519 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-8d3e8e0f-b2b6-4c7b-8a76-c7f7876f048f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:38.767737 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8d3e8e0f-b2b6-4c7b-8a76-c7f7876f048f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:38.767737 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8d3e8e0f-b2b6-4c7b-8a76-c7f7876f048f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:38.767737 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8d3e8e0f-b2b6-4c7b-8a76-c7f7876f048f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:38.767737 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8d3e8e0f-b2b6-4c7b-8a76-c7f7876f048f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:39.074250 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-8d3e8e0f-b2b6-4c7b-8a76-c7f7876f048f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:39.094828 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-8d3e8e0f-b2b6-4c7b-8a76-c7f7876f048f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1566 microversion: 2.1 time: 0.360468 Dec 15 16:23:39.110476 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 180/350] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:38 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1566 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:39.193949 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.network.neutron [None req-2b7fe0f5-abf7-430d-8bb3-4eaae1cc10c3 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] validate_networks() for [('d3a23e9e-8c1c-4ad2-af72-ef7451820760', None, None, None, None, None)] {{(pid=116085) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:23:39.764278 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0a4acc82-656f-429c-8c25-215602105787 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:39.765642 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-0a4acc82-656f-429c-8c25-215602105787 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:39.791830 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0a4acc82-656f-429c-8c25-215602105787 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:39.792715 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0a4acc82-656f-429c-8c25-215602105787 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:39.794353 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0a4acc82-656f-429c-8c25-215602105787 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:39.795311 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0a4acc82-656f-429c-8c25-215602105787 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:40.347581 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-2b7fe0f5-abf7-430d-8bb3-4eaae1cc10c3 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Flavor limits 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:23:40.348647 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-2b7fe0f5-abf7-430d-8bb3-4eaae1cc10c3 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Image limits 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:23:40.349169 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-2b7fe0f5-abf7-430d-8bb3-4eaae1cc10c3 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Flavor pref 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:23:40.349692 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-2b7fe0f5-abf7-430d-8bb3-4eaae1cc10c3 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Image pref 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:23:40.350368 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-2b7fe0f5-abf7-430d-8bb3-4eaae1cc10c3 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:23:40.383782 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2b7fe0f5-abf7-430d-8bb3-4eaae1cc10c3 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:40.392341 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2b7fe0f5-abf7-430d-8bb3-4eaae1cc10c3 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:40.404635 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2b7fe0f5-abf7-430d-8bb3-4eaae1cc10c3 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:40.405926 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2b7fe0f5-abf7-430d-8bb3-4eaae1cc10c3 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:40.432184 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-0a4acc82-656f-429c-8c25-215602105787 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:40.448650 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0a4acc82-656f-429c-8c25-215602105787 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1723 microversion: 2.1 time: 0.694840 Dec 15 16:23:40.449830 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 181/351] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:39 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1723 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:40.461541 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-fb5d62d4-fb3f-4437-a39c-48e644e076ca tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:40.463343 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-fb5d62d4-fb3f-4437-a39c-48e644e076ca tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:40.466084 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-2b7fe0f5-abf7-430d-8bb3-4eaae1cc10c3 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Getting quotas for project 6cccb6b08dc94f04a5efa2624d350007. Resources: {'cores', 'instances', 'ram'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:23:40.473819 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-2b7fe0f5-abf7-430d-8bb3-4eaae1cc10c3 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Getting quotas for user 27c81feca86e49f193efb42a81a6c3c1 and project 6cccb6b08dc94f04a5efa2624d350007. Resources: {'cores', 'instances', 'ram'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:23:40.474473 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fb5d62d4-fb3f-4437-a39c-48e644e076ca tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:40.475277 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fb5d62d4-fb3f-4437-a39c-48e644e076ca tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:40.476739 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fb5d62d4-fb3f-4437-a39c-48e644e076ca tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:40.477535 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fb5d62d4-fb3f-4437-a39c-48e644e076ca tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:40.496771 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-2b7fe0f5-abf7-430d-8bb3-4eaae1cc10c3 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Going to run 1 instances... {{(pid=116085) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:23:40.502283 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-2b7fe0f5-abf7-430d-8bb3-4eaae1cc10c3 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: cb018278-058e-41ee-8bdd-fded5c98ca10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b72b5f54-34d0-48ac-9484-bc8104a6dddb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116085) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:23:40.600500 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-2b7fe0f5-abf7-430d-8bb3-4eaae1cc10c3 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 19.122898 Dec 15 16:23:40.611036 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 171/352] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Dec 15 16:23:21 2021] POST /compute/v2.1/servers => generated 380 bytes in 19125 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 16:23:40.625610 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-1ba8737b-1a85-4fb3-af3e-f2b85da97587 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:40.632873 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-1ba8737b-1a85-4fb3-af3e-f2b85da97587 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: cb018278-058e-41ee-8bdd-fded5c98ca10] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:40.728979 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-fb5d62d4-fb3f-4437-a39c-48e644e076ca tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:40.752853 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-fb5d62d4-fb3f-4437-a39c-48e644e076ca tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1566 microversion: 2.1 time: 0.300657 Dec 15 16:23:40.754738 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 182/353] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:40 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1566 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:40.786658 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-1ba8737b-1a85-4fb3-af3e-f2b85da97587 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:40.800957 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-1ba8737b-1a85-4fb3-af3e-f2b85da97587 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10" status: 200 len: 1217 microversion: 2.1 time: 0.183675 Dec 15 16:23:40.825386 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 172/354] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:40 2021] GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10 => generated 1217 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:23:41.467449 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-48ed81f8-5b57-42ad-9634-0640e0298ad8 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:41.468749 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-48ed81f8-5b57-42ad-9634-0640e0298ad8 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:41.476023 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-48ed81f8-5b57-42ad-9634-0640e0298ad8 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:41.476466 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-48ed81f8-5b57-42ad-9634-0640e0298ad8 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:41.477275 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-48ed81f8-5b57-42ad-9634-0640e0298ad8 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:41.477700 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-48ed81f8-5b57-42ad-9634-0640e0298ad8 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:41.638532 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-48ed81f8-5b57-42ad-9634-0640e0298ad8 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:41.652826 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-48ed81f8-5b57-42ad-9634-0640e0298ad8 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1723 microversion: 2.1 time: 0.189150 Dec 15 16:23:41.653498 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 183/355] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:41 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:41.774025 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-d8a08891-59f2-47ba-a05c-73269e293011 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:41.774847 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-d8a08891-59f2-47ba-a05c-73269e293011 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:41.785758 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d8a08891-59f2-47ba-a05c-73269e293011 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:41.786203 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d8a08891-59f2-47ba-a05c-73269e293011 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:41.787030 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d8a08891-59f2-47ba-a05c-73269e293011 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:41.787504 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d8a08891-59f2-47ba-a05c-73269e293011 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:41.825952 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-30401667-e999-4872-8423-1e529bba1544 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:41.827000 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-30401667-e999-4872-8423-1e529bba1544 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: cb018278-058e-41ee-8bdd-fded5c98ca10] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:41.835460 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-30401667-e999-4872-8423-1e529bba1544 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:41.836422 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-30401667-e999-4872-8423-1e529bba1544 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:41.837270 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-30401667-e999-4872-8423-1e529bba1544 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:41.837707 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-30401667-e999-4872-8423-1e529bba1544 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:41.923738 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-30401667-e999-4872-8423-1e529bba1544 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:41.945410 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-30401667-e999-4872-8423-1e529bba1544 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10" status: 200 len: 1269 microversion: 2.1 time: 0.113225 Dec 15 16:23:41.945410 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 184/356] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:41 2021] GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10 => generated 1269 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:42.016432 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-d8a08891-59f2-47ba-a05c-73269e293011 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:42.026038 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-d8a08891-59f2-47ba-a05c-73269e293011 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1566 microversion: 2.1 time: 0.257333 Dec 15 16:23:42.026731 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 173/357] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:41 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1566 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:42.673204 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0d3b6cf1-ab7c-4cba-82c8-11b727eb191a tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:42.673995 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-0d3b6cf1-ab7c-4cba-82c8-11b727eb191a tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:42.683131 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0d3b6cf1-ab7c-4cba-82c8-11b727eb191a tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:42.683639 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0d3b6cf1-ab7c-4cba-82c8-11b727eb191a tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:42.684636 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0d3b6cf1-ab7c-4cba-82c8-11b727eb191a tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:42.685091 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0d3b6cf1-ab7c-4cba-82c8-11b727eb191a tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:42.864637 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-0d3b6cf1-ab7c-4cba-82c8-11b727eb191a tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:42.873468 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0d3b6cf1-ab7c-4cba-82c8-11b727eb191a tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1723 microversion: 2.1 time: 0.205967 Dec 15 16:23:42.874551 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 185/358] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:42 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:23:42.953980 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-0e72b356-0f47-4551-9c97-107dbf5a43f2 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:42.955004 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-0e72b356-0f47-4551-9c97-107dbf5a43f2 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: cb018278-058e-41ee-8bdd-fded5c98ca10] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:42.968369 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0e72b356-0f47-4551-9c97-107dbf5a43f2 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:42.969140 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0e72b356-0f47-4551-9c97-107dbf5a43f2 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:42.971597 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0e72b356-0f47-4551-9c97-107dbf5a43f2 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:42.973299 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0e72b356-0f47-4551-9c97-107dbf5a43f2 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:43.051421 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-8c8d11c3-1559-4717-8cf6-cf1ff472b25f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:43.052340 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-8c8d11c3-1559-4717-8cf6-cf1ff472b25f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:43.069341 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8c8d11c3-1559-4717-8cf6-cf1ff472b25f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:43.069784 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8c8d11c3-1559-4717-8cf6-cf1ff472b25f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:43.070829 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8c8d11c3-1559-4717-8cf6-cf1ff472b25f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:43.071458 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8c8d11c3-1559-4717-8cf6-cf1ff472b25f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:43.299406 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-0e72b356-0f47-4551-9c97-107dbf5a43f2 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:43.319484 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-0e72b356-0f47-4551-9c97-107dbf5a43f2 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10" status: 200 len: 1317 microversion: 2.1 time: 0.372346 Dec 15 16:23:43.320847 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 174/359] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:42 2021] GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10 => generated 1317 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:43.426369 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-8c8d11c3-1559-4717-8cf6-cf1ff472b25f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:43.436421 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-8c8d11c3-1559-4717-8cf6-cf1ff472b25f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1566 microversion: 2.1 time: 0.395248 Dec 15 16:23:43.448589 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 186/360] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:43 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1566 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:23:43.904871 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-1287f011-7f11-4d24-af9b-2e28a87a967c tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:43.906332 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-1287f011-7f11-4d24-af9b-2e28a87a967c tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:43.915842 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1287f011-7f11-4d24-af9b-2e28a87a967c tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:43.917265 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1287f011-7f11-4d24-af9b-2e28a87a967c tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:43.919066 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1287f011-7f11-4d24-af9b-2e28a87a967c tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:43.920187 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1287f011-7f11-4d24-af9b-2e28a87a967c tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:43.960783 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-9a95da9e-452b-4f1a-bbba-e2825caf7020 req-92c3bcde-f920-48df-baa6-ae75399ddea6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb018278-058e-41ee-8bdd-fded5c98ca10", "tag": "b966396f-ab45-4ab1-a379-55a0bbe41429"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:43.967006 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:23:43.967006 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:23:43.989917 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-9a95da9e-452b-4f1a-bbba-e2825caf7020 req-92c3bcde-f920-48df-baa6-ae75399ddea6 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:43.990738 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-9a95da9e-452b-4f1a-bbba-e2825caf7020 req-92c3bcde-f920-48df-baa6-ae75399ddea6 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:44.009249 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-9a95da9e-452b-4f1a-bbba-e2825caf7020 req-92c3bcde-f920-48df-baa6-ae75399ddea6 service nova] Creating event network-changed:b966396f-ab45-4ab1-a379-55a0bbe41429 for instance cb018278-058e-41ee-8bdd-fded5c98ca10 on hv-cinder-81268 Dec 15 16:23:44.017850 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-9a95da9e-452b-4f1a-bbba-e2825caf7020 req-92c3bcde-f920-48df-baa6-ae75399ddea6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071312 Dec 15 16:23:44.022431 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 187/361] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:23:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:23:44.128510 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-1287f011-7f11-4d24-af9b-2e28a87a967c tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:44.142778 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-1287f011-7f11-4d24-af9b-2e28a87a967c tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1723 microversion: 2.1 time: 0.244417 Dec 15 16:23:44.149100 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 175/362] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:43 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1723 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:44.340927 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0e9f829f-46e2-4caa-b7f6-339071cff8ed tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:44.340927 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-0e9f829f-46e2-4caa-b7f6-339071cff8ed tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: cb018278-058e-41ee-8bdd-fded5c98ca10] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:44.353949 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0e9f829f-46e2-4caa-b7f6-339071cff8ed tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:44.353949 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0e9f829f-46e2-4caa-b7f6-339071cff8ed tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:44.353949 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0e9f829f-46e2-4caa-b7f6-339071cff8ed tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:44.353949 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0e9f829f-46e2-4caa-b7f6-339071cff8ed tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:44.455573 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-0d83ca6c-89f2-44c5-955f-4499008c7ba1 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:44.456177 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-0d83ca6c-89f2-44c5-955f-4499008c7ba1 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:44.462726 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0d83ca6c-89f2-44c5-955f-4499008c7ba1 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:44.463186 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0d83ca6c-89f2-44c5-955f-4499008c7ba1 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:44.464184 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0d83ca6c-89f2-44c5-955f-4499008c7ba1 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:44.464854 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0d83ca6c-89f2-44c5-955f-4499008c7ba1 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:44.555794 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-0e9f829f-46e2-4caa-b7f6-339071cff8ed tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:44.565526 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0e9f829f-46e2-4caa-b7f6-339071cff8ed tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10" status: 200 len: 1317 microversion: 2.1 time: 0.230173 Dec 15 16:23:44.579633 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 188/363] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:44 2021] GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10 => generated 1317 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:44.606621 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-8fe67e69-359c-43b9-9ec2-5b16d1e1ca5f tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1916049767", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-663151410", "security_groups": [{"name": "tempest-secgroup-smoke-1218287950"}], "networks": [{"uuid": "d3448ec3-4b1e-4f23-bb59-4f667d1a0a58"}], "block_device_mapping_v2": [{"uuid": "3b71ebbd-7154-4c01-928e-29c6dba2556b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:44.711837 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-0d83ca6c-89f2-44c5-955f-4499008c7ba1 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:44.728694 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-0d83ca6c-89f2-44c5-955f-4499008c7ba1 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1566 microversion: 2.1 time: 0.276457 Dec 15 16:23:44.738791 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 176/364] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:44 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1566 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:23:44.791716 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.network.neutron [None req-8fe67e69-359c-43b9-9ec2-5b16d1e1ca5f tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] validate_networks() for [('d3448ec3-4b1e-4f23-bb59-4f667d1a0a58', None, None, None, None, None)] {{(pid=116084) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:23:45.160676 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-aa9cf94a-474e-4295-bd5c-b2031e53f0b1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:45.161466 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-aa9cf94a-474e-4295-bd5c-b2031e53f0b1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:45.168934 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-aa9cf94a-474e-4295-bd5c-b2031e53f0b1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:45.169682 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-aa9cf94a-474e-4295-bd5c-b2031e53f0b1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:45.170475 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-aa9cf94a-474e-4295-bd5c-b2031e53f0b1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:45.171135 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-aa9cf94a-474e-4295-bd5c-b2031e53f0b1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:45.302569 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-8fe67e69-359c-43b9-9ec2-5b16d1e1ca5f tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Flavor limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:23:45.303044 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-8fe67e69-359c-43b9-9ec2-5b16d1e1ca5f tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Image limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:23:45.303731 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-8fe67e69-359c-43b9-9ec2-5b16d1e1ca5f tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Flavor pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:23:45.304135 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-8fe67e69-359c-43b9-9ec2-5b16d1e1ca5f tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Image pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:23:45.304539 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-8fe67e69-359c-43b9-9ec2-5b16d1e1ca5f tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:23:45.315919 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8fe67e69-359c-43b9-9ec2-5b16d1e1ca5f tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:45.316366 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8fe67e69-359c-43b9-9ec2-5b16d1e1ca5f tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:45.317179 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8fe67e69-359c-43b9-9ec2-5b16d1e1ca5f tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:45.317610 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8fe67e69-359c-43b9-9ec2-5b16d1e1ca5f tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:45.338664 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-8fe67e69-359c-43b9-9ec2-5b16d1e1ca5f tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Getting quotas for project 60fc732badb0488392694e6d6c67d5dc. Resources: {'cores', 'instances', 'ram'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:23:45.342809 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-8fe67e69-359c-43b9-9ec2-5b16d1e1ca5f tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Getting quotas for user 4b554f95b7b4444ab70e9dabf8197de6 and project 60fc732badb0488392694e6d6c67d5dc. Resources: {'cores', 'instances', 'ram'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:23:45.358703 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-aa9cf94a-474e-4295-bd5c-b2031e53f0b1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:45.367968 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-aa9cf94a-474e-4295-bd5c-b2031e53f0b1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1723 microversion: 2.1 time: 0.211148 Dec 15 16:23:45.373544 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 177/365] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:45 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1723 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:45.417610 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-8fe67e69-359c-43b9-9ec2-5b16d1e1ca5f tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Going to run 1 instances... {{(pid=116084) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:23:45.420861 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-8fe67e69-359c-43b9-9ec2-5b16d1e1ca5f tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3b71ebbd-7154-4c01-928e-29c6dba2556b',volume_size=None,volume_type=None)] {{(pid=116084) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:23:45.564948 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-8fe67e69-359c-43b9-9ec2-5b16d1e1ca5f tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.963939 Dec 15 16:23:45.565646 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 189/366] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Dec 15 16:23:44 2021] POST /compute/v2.1/servers => generated 406 bytes in 966 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 15 16:23:45.581087 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-b8340df7-3396-461c-91bd-44689765fcce tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:45.581835 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-b8340df7-3396-461c-91bd-44689765fcce tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:45.586520 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1c80ab3e-df7f-4d36-887d-cce78ac3f42f tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:45.587137 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1c80ab3e-df7f-4d36-887d-cce78ac3f42f tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: cb018278-058e-41ee-8bdd-fded5c98ca10] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:45.606389 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1c80ab3e-df7f-4d36-887d-cce78ac3f42f tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:45.606744 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1c80ab3e-df7f-4d36-887d-cce78ac3f42f tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:45.607870 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1c80ab3e-df7f-4d36-887d-cce78ac3f42f tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:45.608364 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1c80ab3e-df7f-4d36-887d-cce78ac3f42f tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:45.657570 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-b8340df7-3396-461c-91bd-44689765fcce tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b554f95b7b4444ab70e9dabf8197de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fc732badb0488392694e6d6c67d5dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:45.677181 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-b8340df7-3396-461c-91bd-44689765fcce tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d" status: 200 len: 1088 microversion: 2.1 time: 0.096631 Dec 15 16:23:45.679623 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 178/367] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:45 2021] GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d => generated 1088 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:45.746883 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-35f665e0-f0bb-4927-a84d-29dfe11783d0 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:45.747657 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-35f665e0-f0bb-4927-a84d-29dfe11783d0 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:45.758420 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-35f665e0-f0bb-4927-a84d-29dfe11783d0 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:45.759563 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-35f665e0-f0bb-4927-a84d-29dfe11783d0 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:45.760450 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-35f665e0-f0bb-4927-a84d-29dfe11783d0 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:45.760935 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-35f665e0-f0bb-4927-a84d-29dfe11783d0 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:45.817760 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1c80ab3e-df7f-4d36-887d-cce78ac3f42f tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:45.833892 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1c80ab3e-df7f-4d36-887d-cce78ac3f42f tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10" status: 200 len: 1317 microversion: 2.1 time: 0.251196 Dec 15 16:23:45.834774 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 190/368] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:45 2021] GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10 => generated 1317 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:45.954772 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-35f665e0-f0bb-4927-a84d-29dfe11783d0 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:45.965087 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-35f665e0-f0bb-4927-a84d-29dfe11783d0 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1566 microversion: 2.1 time: 0.222270 Dec 15 16:23:45.979589 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 179/369] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:45 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1566 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:46.387136 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-dbada156-534c-4249-8152-4b10c0efa02c tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:46.387753 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-dbada156-534c-4249-8152-4b10c0efa02c tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:46.395434 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dbada156-534c-4249-8152-4b10c0efa02c tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:46.395889 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dbada156-534c-4249-8152-4b10c0efa02c tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:46.396761 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dbada156-534c-4249-8152-4b10c0efa02c tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:46.397192 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dbada156-534c-4249-8152-4b10c0efa02c tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:46.560136 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-dbada156-534c-4249-8152-4b10c0efa02c tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:46.568751 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-dbada156-534c-4249-8152-4b10c0efa02c tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1723 microversion: 2.1 time: 0.185595 Dec 15 16:23:46.569328 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 191/370] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:46 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:46.712112 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-ae8671dd-e239-4ea1-97bb-1200c7e5a4ca tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:46.712660 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-ae8671dd-e239-4ea1-97bb-1200c7e5a4ca tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:46.721577 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ae8671dd-e239-4ea1-97bb-1200c7e5a4ca tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:46.722452 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ae8671dd-e239-4ea1-97bb-1200c7e5a4ca tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:46.723394 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ae8671dd-e239-4ea1-97bb-1200c7e5a4ca tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:46.724167 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ae8671dd-e239-4ea1-97bb-1200c7e5a4ca tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:46.801586 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-ae8671dd-e239-4ea1-97bb-1200c7e5a4ca tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b554f95b7b4444ab70e9dabf8197de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fc732badb0488392694e6d6c67d5dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:46.816255 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-ae8671dd-e239-4ea1-97bb-1200c7e5a4ca tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d" status: 200 len: 1186 microversion: 2.1 time: 0.106401 Dec 15 16:23:46.819304 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 180/371] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:46 2021] GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d => generated 1186 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:46.851984 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-23e61be0-76eb-4314-8c29-fb9a40a41eb6 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:46.852749 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-23e61be0-76eb-4314-8c29-fb9a40a41eb6 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: cb018278-058e-41ee-8bdd-fded5c98ca10] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:46.859855 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-23e61be0-76eb-4314-8c29-fb9a40a41eb6 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:46.861015 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-23e61be0-76eb-4314-8c29-fb9a40a41eb6 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:46.861917 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-23e61be0-76eb-4314-8c29-fb9a40a41eb6 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:46.862673 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-23e61be0-76eb-4314-8c29-fb9a40a41eb6 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:46.996652 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-a518864b-f7b5-48fb-a591-bc4b7336a46a tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:46.997754 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-a518864b-f7b5-48fb-a591-bc4b7336a46a tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:47.006565 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a518864b-f7b5-48fb-a591-bc4b7336a46a tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:47.007552 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a518864b-f7b5-48fb-a591-bc4b7336a46a tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:47.008781 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a518864b-f7b5-48fb-a591-bc4b7336a46a tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:47.009758 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a518864b-f7b5-48fb-a591-bc4b7336a46a tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:47.059708 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-23e61be0-76eb-4314-8c29-fb9a40a41eb6 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:47.070870 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-23e61be0-76eb-4314-8c29-fb9a40a41eb6 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10" status: 200 len: 1317 microversion: 2.1 time: 0.222838 Dec 15 16:23:47.072212 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 192/372] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:46 2021] GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10 => generated 1317 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:47.195871 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-a518864b-f7b5-48fb-a591-bc4b7336a46a tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:47.213082 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-a518864b-f7b5-48fb-a591-bc4b7336a46a tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1566 microversion: 2.1 time: 0.221761 Dec 15 16:23:47.214416 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 181/373] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:46 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1566 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:23:47.590339 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c6b779b8-6437-4c2b-8033-bfda7bc959c5 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:47.591259 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c6b779b8-6437-4c2b-8033-bfda7bc959c5 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:47.602007 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c6b779b8-6437-4c2b-8033-bfda7bc959c5 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:47.602453 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c6b779b8-6437-4c2b-8033-bfda7bc959c5 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:47.603654 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c6b779b8-6437-4c2b-8033-bfda7bc959c5 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:47.604086 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c6b779b8-6437-4c2b-8033-bfda7bc959c5 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:47.803735 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-c6b779b8-6437-4c2b-8033-bfda7bc959c5 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:47.812095 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c6b779b8-6437-4c2b-8033-bfda7bc959c5 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1723 microversion: 2.1 time: 0.228585 Dec 15 16:23:47.814364 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 193/374] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:47 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1723 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:47.839542 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-3d87c83a-f065-46db-b787-e23bd5ad545e tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:47.840743 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-3d87c83a-f065-46db-b787-e23bd5ad545e tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:47.851039 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3d87c83a-f065-46db-b787-e23bd5ad545e tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:47.851837 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3d87c83a-f065-46db-b787-e23bd5ad545e tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:47.853452 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3d87c83a-f065-46db-b787-e23bd5ad545e tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:47.854119 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3d87c83a-f065-46db-b787-e23bd5ad545e tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:48.043938 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-3d87c83a-f065-46db-b787-e23bd5ad545e tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b554f95b7b4444ab70e9dabf8197de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fc732badb0488392694e6d6c67d5dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:48.056274 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-3d87c83a-f065-46db-b787-e23bd5ad545e tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d" status: 200 len: 1260 microversion: 2.1 time: 0.222784 Dec 15 16:23:48.057517 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 182/375] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:47 2021] GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d => generated 1260 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:48.092184 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b33b406d-90cb-4067-b975-f1404730e188 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:48.094549 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b33b406d-90cb-4067-b975-f1404730e188 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: cb018278-058e-41ee-8bdd-fded5c98ca10] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:48.105614 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b33b406d-90cb-4067-b975-f1404730e188 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:48.106581 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b33b406d-90cb-4067-b975-f1404730e188 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:48.108104 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b33b406d-90cb-4067-b975-f1404730e188 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:48.109873 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b33b406d-90cb-4067-b975-f1404730e188 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:48.238722 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-ae32914c-0d81-48a5-91ca-e2eb192fe76f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:48.239333 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-ae32914c-0d81-48a5-91ca-e2eb192fe76f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:48.245367 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ae32914c-0d81-48a5-91ca-e2eb192fe76f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:48.245818 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ae32914c-0d81-48a5-91ca-e2eb192fe76f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:48.246613 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ae32914c-0d81-48a5-91ca-e2eb192fe76f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:48.247053 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ae32914c-0d81-48a5-91ca-e2eb192fe76f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:48.338528 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b33b406d-90cb-4067-b975-f1404730e188 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:48.347615 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b33b406d-90cb-4067-b975-f1404730e188 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10" status: 200 len: 1317 microversion: 2.1 time: 0.261897 Dec 15 16:23:48.348840 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 194/376] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:48 2021] GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10 => generated 1317 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:48.442533 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-ae32914c-0d81-48a5-91ca-e2eb192fe76f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:48.450847 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-ae32914c-0d81-48a5-91ca-e2eb192fe76f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1566 microversion: 2.1 time: 0.215961 Dec 15 16:23:48.452159 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 183/377] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:48 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1566 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:48.833898 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-80b560ab-8298-458b-86be-179253616676 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:48.834825 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-80b560ab-8298-458b-86be-179253616676 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:48.847054 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-db18db19-7b9f-4b97-8039-81e2bd0085ae req-ed07d0da-fc7f-4c1e-a3e4-fdaf3227dfe3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afd5ac96-daf3-4608-818c-190e076c2f6d", "tag": "7f96dd5b-86e2-412f-920f-6abc632fd890"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:48.848807 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:23:48.848807 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Dec 15 16:23:48.851801 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-80b560ab-8298-458b-86be-179253616676 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:48.854213 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-80b560ab-8298-458b-86be-179253616676 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:48.857220 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-80b560ab-8298-458b-86be-179253616676 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:48.858348 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-80b560ab-8298-458b-86be-179253616676 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:48.861232 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-db18db19-7b9f-4b97-8039-81e2bd0085ae req-ed07d0da-fc7f-4c1e-a3e4-fdaf3227dfe3 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:48.861683 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-db18db19-7b9f-4b97-8039-81e2bd0085ae req-ed07d0da-fc7f-4c1e-a3e4-fdaf3227dfe3 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:48.883597 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-db18db19-7b9f-4b97-8039-81e2bd0085ae req-ed07d0da-fc7f-4c1e-a3e4-fdaf3227dfe3 service nova] Creating event network-changed:7f96dd5b-86e2-412f-920f-6abc632fd890 for instance afd5ac96-daf3-4608-818c-190e076c2f6d on hv-cinder-81268 Dec 15 16:23:48.895313 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-db18db19-7b9f-4b97-8039-81e2bd0085ae req-ed07d0da-fc7f-4c1e-a3e4-fdaf3227dfe3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052620 Dec 15 16:23:48.899959 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 184/378] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:23:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:23:49.084858 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-07a62c8b-4f4b-4336-8942-8cc8ece31f30 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:49.091246 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-07a62c8b-4f4b-4336-8942-8cc8ece31f30 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:49.115838 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-07a62c8b-4f4b-4336-8942-8cc8ece31f30 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:49.117233 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-07a62c8b-4f4b-4336-8942-8cc8ece31f30 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:49.118843 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-07a62c8b-4f4b-4336-8942-8cc8ece31f30 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:49.119627 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-07a62c8b-4f4b-4336-8942-8cc8ece31f30 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:49.165060 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-80b560ab-8298-458b-86be-179253616676 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:49.174920 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-80b560ab-8298-458b-86be-179253616676 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1723 microversion: 2.1 time: 0.346059 Dec 15 16:23:49.175555 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 195/379] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:48 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1723 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:49.365590 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-78f1cea1-491e-42b0-94d6-3f7992978fff tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:49.367005 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-78f1cea1-491e-42b0-94d6-3f7992978fff tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: cb018278-058e-41ee-8bdd-fded5c98ca10] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:49.375739 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-78f1cea1-491e-42b0-94d6-3f7992978fff tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:49.376334 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-78f1cea1-491e-42b0-94d6-3f7992978fff tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:49.377384 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-78f1cea1-491e-42b0-94d6-3f7992978fff tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:49.377917 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-78f1cea1-491e-42b0-94d6-3f7992978fff tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:49.484912 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-07a62c8b-4f4b-4336-8942-8cc8ece31f30 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b554f95b7b4444ab70e9dabf8197de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fc732badb0488392694e6d6c67d5dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:49.500870 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-07a62c8b-4f4b-4336-8942-8cc8ece31f30 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d" status: 200 len: 1260 microversion: 2.1 time: 0.427434 Dec 15 16:23:49.501937 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 185/380] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:49 2021] GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d => generated 1260 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:49.507979 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-30df986d-2c37-4963-8beb-b5a27e100dfb tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:49.509088 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-30df986d-2c37-4963-8beb-b5a27e100dfb tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:49.516576 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-30df986d-2c37-4963-8beb-b5a27e100dfb tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:49.517108 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-30df986d-2c37-4963-8beb-b5a27e100dfb tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:49.518242 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-30df986d-2c37-4963-8beb-b5a27e100dfb tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:49.518757 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-30df986d-2c37-4963-8beb-b5a27e100dfb tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:49.681384 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-78f1cea1-491e-42b0-94d6-3f7992978fff tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:49.692971 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-78f1cea1-491e-42b0-94d6-3f7992978fff tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10" status: 200 len: 1317 microversion: 2.1 time: 0.331364 Dec 15 16:23:49.695676 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 196/381] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:49 2021] GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10 => generated 1317 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:23:49.759967 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-30df986d-2c37-4963-8beb-b5a27e100dfb tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:49.769338 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-30df986d-2c37-4963-8beb-b5a27e100dfb tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1566 microversion: 2.1 time: 0.266057 Dec 15 16:23:49.772419 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 186/382] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:49 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1566 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:50.192826 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-761ae34f-abbb-4f56-9952-5092dc7ddc30 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:50.193433 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-761ae34f-abbb-4f56-9952-5092dc7ddc30 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:50.201113 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-761ae34f-abbb-4f56-9952-5092dc7ddc30 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:50.201686 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-761ae34f-abbb-4f56-9952-5092dc7ddc30 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:50.202635 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-761ae34f-abbb-4f56-9952-5092dc7ddc30 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:50.203074 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-761ae34f-abbb-4f56-9952-5092dc7ddc30 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:50.361570 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-761ae34f-abbb-4f56-9952-5092dc7ddc30 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:50.371957 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-761ae34f-abbb-4f56-9952-5092dc7ddc30 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1723 microversion: 2.1 time: 0.183058 Dec 15 16:23:50.372594 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 197/383] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:50 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:23:50.519449 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-7ec61174-0a24-4b39-8af9-580915eef773 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:50.520082 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-7ec61174-0a24-4b39-8af9-580915eef773 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:50.526723 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7ec61174-0a24-4b39-8af9-580915eef773 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:50.527166 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7ec61174-0a24-4b39-8af9-580915eef773 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:50.528119 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7ec61174-0a24-4b39-8af9-580915eef773 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:50.528430 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7ec61174-0a24-4b39-8af9-580915eef773 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:50.690689 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-7ec61174-0a24-4b39-8af9-580915eef773 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b554f95b7b4444ab70e9dabf8197de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fc732badb0488392694e6d6c67d5dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:50.699382 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-7ec61174-0a24-4b39-8af9-580915eef773 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d" status: 200 len: 1260 microversion: 2.1 time: 0.183836 Dec 15 16:23:50.699964 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 187/384] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:50 2021] GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d => generated 1260 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:50.710667 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-02a772b3-0bfa-4b3f-90bb-1d15e06f6920 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:50.711287 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-02a772b3-0bfa-4b3f-90bb-1d15e06f6920 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: cb018278-058e-41ee-8bdd-fded5c98ca10] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:50.717345 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-02a772b3-0bfa-4b3f-90bb-1d15e06f6920 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:50.717856 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-02a772b3-0bfa-4b3f-90bb-1d15e06f6920 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:50.718638 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-02a772b3-0bfa-4b3f-90bb-1d15e06f6920 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:50.719057 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-02a772b3-0bfa-4b3f-90bb-1d15e06f6920 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:50.789108 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-f5958a86-d85d-45b2-8040-35a6ffa98d27 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:50.789640 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-f5958a86-d85d-45b2-8040-35a6ffa98d27 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:50.795875 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f5958a86-d85d-45b2-8040-35a6ffa98d27 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:50.796624 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f5958a86-d85d-45b2-8040-35a6ffa98d27 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:50.796981 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f5958a86-d85d-45b2-8040-35a6ffa98d27 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:50.797409 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f5958a86-d85d-45b2-8040-35a6ffa98d27 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:50.912440 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-02a772b3-0bfa-4b3f-90bb-1d15e06f6920 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:50.920295 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-02a772b3-0bfa-4b3f-90bb-1d15e06f6920 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10" status: 200 len: 1317 microversion: 2.1 time: 0.213266 Dec 15 16:23:50.930113 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 198/385] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:50 2021] GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10 => generated 1317 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:50.986271 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-f5958a86-d85d-45b2-8040-35a6ffa98d27 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:50.994474 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-f5958a86-d85d-45b2-8040-35a6ffa98d27 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1566 microversion: 2.1 time: 0.209148 Dec 15 16:23:50.995058 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 188/386] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:50 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1566 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:23:51.390747 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d28e969e-0415-45da-a54b-814032e164c1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:51.391424 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d28e969e-0415-45da-a54b-814032e164c1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:51.398776 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d28e969e-0415-45da-a54b-814032e164c1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:51.399296 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d28e969e-0415-45da-a54b-814032e164c1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:51.400140 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d28e969e-0415-45da-a54b-814032e164c1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:51.400662 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d28e969e-0415-45da-a54b-814032e164c1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:51.553612 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d28e969e-0415-45da-a54b-814032e164c1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:51.563874 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d28e969e-0415-45da-a54b-814032e164c1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1700 microversion: 2.1 time: 0.177317 Dec 15 16:23:51.564483 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 199/387] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:51 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1700 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:51.580526 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-931baa4b-b339-4404-ae5b-ad4b24cb7faf tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:23:51.588825 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-931baa4b-b339-4404-ae5b-ad4b24cb7faf tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:51.589270 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-931baa4b-b339-4404-ae5b-ad4b24cb7faf tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:51.653425 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-931baa4b-b339-4404-ae5b-ad4b24cb7faf tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Going to try to start instance {{(pid=116085) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 15 16:23:51.710588 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-931baa4b-b339-4404-ae5b-ad4b24cb7faf tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action" status: 202 len: 0 microversion: 2.1 time: 0.133759 Dec 15 16:23:51.711494 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 189/388] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:23:51 2021] POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:23:51.721109 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-9a48f472-5de5-4241-a5dc-1f3c9f458b1f tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:51.721814 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-9a48f472-5de5-4241-a5dc-1f3c9f458b1f tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:51.722582 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e596bc62-ddac-436a-aad5-92762e7f5a6f tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:51.723685 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e596bc62-ddac-436a-aad5-92762e7f5a6f tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:51.729221 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9a48f472-5de5-4241-a5dc-1f3c9f458b1f tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:51.730199 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9a48f472-5de5-4241-a5dc-1f3c9f458b1f tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:51.730486 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9a48f472-5de5-4241-a5dc-1f3c9f458b1f tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:51.730922 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9a48f472-5de5-4241-a5dc-1f3c9f458b1f tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:51.734792 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e596bc62-ddac-436a-aad5-92762e7f5a6f tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:51.735652 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e596bc62-ddac-436a-aad5-92762e7f5a6f tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:51.737074 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e596bc62-ddac-436a-aad5-92762e7f5a6f tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:51.737859 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e596bc62-ddac-436a-aad5-92762e7f5a6f tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:51.959514 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-9a48f472-5de5-4241-a5dc-1f3c9f458b1f tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:51.963419 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e596bc62-ddac-436a-aad5-92762e7f5a6f tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b554f95b7b4444ab70e9dabf8197de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fc732badb0488392694e6d6c67d5dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:51.972031 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e596bc62-ddac-436a-aad5-92762e7f5a6f tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d" status: 200 len: 1260 microversion: 2.1 time: 0.257195 Dec 15 16:23:51.974203 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-9a48f472-5de5-4241-a5dc-1f3c9f458b1f tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1709 microversion: 2.1 time: 0.257488 Dec 15 16:23:51.991691 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 190/389] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:51 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1709 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:51.992041 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 200/390] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:51 2021] GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d => generated 1260 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:51.992212 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-f744cfdb-9ad4-422d-bf15-858e792769b1 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:51.992212 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-f744cfdb-9ad4-422d-bf15-858e792769b1 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: cb018278-058e-41ee-8bdd-fded5c98ca10] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:52.000168 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f744cfdb-9ad4-422d-bf15-858e792769b1 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:52.001002 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f744cfdb-9ad4-422d-bf15-858e792769b1 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:52.002426 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f744cfdb-9ad4-422d-bf15-858e792769b1 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:52.003232 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f744cfdb-9ad4-422d-bf15-858e792769b1 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:52.013442 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-51cc0f63-e2a8-48b4-98c3-b9fa1674defe tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:52.013917 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-51cc0f63-e2a8-48b4-98c3-b9fa1674defe tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:52.020888 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-51cc0f63-e2a8-48b4-98c3-b9fa1674defe tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:52.021387 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-51cc0f63-e2a8-48b4-98c3-b9fa1674defe tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:52.022156 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-51cc0f63-e2a8-48b4-98c3-b9fa1674defe tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:52.022595 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-51cc0f63-e2a8-48b4-98c3-b9fa1674defe tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:52.258751 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-f744cfdb-9ad4-422d-bf15-858e792769b1 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:52.267631 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-f744cfdb-9ad4-422d-bf15-858e792769b1 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10" status: 200 len: 1317 microversion: 2.1 time: 0.289416 Dec 15 16:23:52.268914 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 191/391] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:51 2021] GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10 => generated 1317 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:52.271251 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-51cc0f63-e2a8-48b4-98c3-b9fa1674defe tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:52.283005 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-51cc0f63-e2a8-48b4-98c3-b9fa1674defe tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1566 microversion: 2.1 time: 0.273325 Dec 15 16:23:52.283669 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 201/392] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:52 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1566 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:23:52.990288 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-4173ea03-83fc-44b9-97ba-8cb5772562a1 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:52.990854 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-4173ea03-83fc-44b9-97ba-8cb5772562a1 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:52.997982 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4173ea03-83fc-44b9-97ba-8cb5772562a1 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:52.998437 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4173ea03-83fc-44b9-97ba-8cb5772562a1 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:52.999502 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4173ea03-83fc-44b9-97ba-8cb5772562a1 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:52.999944 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4173ea03-83fc-44b9-97ba-8cb5772562a1 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:53.002744 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-3e4fbdff-6ffe-4050-bf16-51ba351e4be0 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:53.003573 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-3e4fbdff-6ffe-4050-bf16-51ba351e4be0 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:53.011700 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3e4fbdff-6ffe-4050-bf16-51ba351e4be0 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:53.012157 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3e4fbdff-6ffe-4050-bf16-51ba351e4be0 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:53.012970 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3e4fbdff-6ffe-4050-bf16-51ba351e4be0 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:53.013407 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3e4fbdff-6ffe-4050-bf16-51ba351e4be0 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:53.237791 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-4173ea03-83fc-44b9-97ba-8cb5772562a1 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b554f95b7b4444ab70e9dabf8197de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fc732badb0488392694e6d6c67d5dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:53.242835 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-3e4fbdff-6ffe-4050-bf16-51ba351e4be0 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:53.246473 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-4173ea03-83fc-44b9-97ba-8cb5772562a1 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d" status: 200 len: 1260 microversion: 2.1 time: 0.259412 Dec 15 16:23:53.246473 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 192/393] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:52 2021] GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d => generated 1260 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:53.254709 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-3e4fbdff-6ffe-4050-bf16-51ba351e4be0 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1709 microversion: 2.1 time: 0.256334 Dec 15 16:23:53.255708 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 202/394] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:52 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1709 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:53.291660 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-64df49d5-0a3c-40e3-b66c-e77283644bf9 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:53.292738 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-64df49d5-0a3c-40e3-b66c-e77283644bf9 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: cb018278-058e-41ee-8bdd-fded5c98ca10] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:53.301914 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-2853697a-3061-4d4e-9f8c-15519d821eba tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:53.302698 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-2853697a-3061-4d4e-9f8c-15519d821eba tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:53.303494 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-64df49d5-0a3c-40e3-b66c-e77283644bf9 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:53.304449 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-64df49d5-0a3c-40e3-b66c-e77283644bf9 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:53.307066 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-64df49d5-0a3c-40e3-b66c-e77283644bf9 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:53.307941 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-64df49d5-0a3c-40e3-b66c-e77283644bf9 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:53.312085 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2853697a-3061-4d4e-9f8c-15519d821eba tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:53.312789 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2853697a-3061-4d4e-9f8c-15519d821eba tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:53.313795 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2853697a-3061-4d4e-9f8c-15519d821eba tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:53.314394 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2853697a-3061-4d4e-9f8c-15519d821eba tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:53.541979 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-64df49d5-0a3c-40e3-b66c-e77283644bf9 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:53.550034 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-64df49d5-0a3c-40e3-b66c-e77283644bf9 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10" status: 200 len: 1317 microversion: 2.1 time: 0.266426 Dec 15 16:23:53.550871 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 193/395] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:53 2021] GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10 => generated 1317 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:53.554547 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-2853697a-3061-4d4e-9f8c-15519d821eba tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:53.563496 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-2853697a-3061-4d4e-9f8c-15519d821eba tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1566 microversion: 2.1 time: 0.265607 Dec 15 16:23:53.564080 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 203/396] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:53 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1566 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:54.278059 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-223987c5-f633-46b7-a2ce-3fabb96fd705 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:54.278908 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-223987c5-f633-46b7-a2ce-3fabb96fd705 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:54.279812 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-6e2961bb-038b-4628-9c2b-e8bf1bfbfaaf tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:54.281006 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-6e2961bb-038b-4628-9c2b-e8bf1bfbfaaf tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:54.286867 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-223987c5-f633-46b7-a2ce-3fabb96fd705 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:54.287314 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-223987c5-f633-46b7-a2ce-3fabb96fd705 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:54.288154 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-223987c5-f633-46b7-a2ce-3fabb96fd705 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:54.288631 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-223987c5-f633-46b7-a2ce-3fabb96fd705 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:54.291882 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6e2961bb-038b-4628-9c2b-e8bf1bfbfaaf tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:54.292672 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6e2961bb-038b-4628-9c2b-e8bf1bfbfaaf tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:54.294080 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6e2961bb-038b-4628-9c2b-e8bf1bfbfaaf tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:54.294888 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6e2961bb-038b-4628-9c2b-e8bf1bfbfaaf tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:54.643843 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-223987c5-f633-46b7-a2ce-3fabb96fd705 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:54.654036 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-223987c5-f633-46b7-a2ce-3fabb96fd705 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1713 microversion: 2.1 time: 0.379587 Dec 15 16:23:54.654362 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-6e2961bb-038b-4628-9c2b-e8bf1bfbfaaf tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b554f95b7b4444ab70e9dabf8197de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fc732badb0488392694e6d6c67d5dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:54.654955 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 204/397] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:54 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1713 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:23:54.670153 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b2f72578-3771-48d3-b0b8-7cb0ca6be3f2 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:54.672194 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b2f72578-3771-48d3-b0b8-7cb0ca6be3f2 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: cb018278-058e-41ee-8bdd-fded5c98ca10] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:54.673626 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-6e2961bb-038b-4628-9c2b-e8bf1bfbfaaf tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d" status: 200 len: 1260 microversion: 2.1 time: 0.402023 Dec 15 16:23:54.675744 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 194/398] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:54 2021] GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d => generated 1260 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:54.684147 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-67585c9e-bfcf-4502-a61c-d132e3ade979 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:54.685442 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-67585c9e-bfcf-4502-a61c-d132e3ade979 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:54.687233 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b2f72578-3771-48d3-b0b8-7cb0ca6be3f2 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:54.688158 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b2f72578-3771-48d3-b0b8-7cb0ca6be3f2 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:54.689753 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b2f72578-3771-48d3-b0b8-7cb0ca6be3f2 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:54.690633 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b2f72578-3771-48d3-b0b8-7cb0ca6be3f2 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:54.697036 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-67585c9e-bfcf-4502-a61c-d132e3ade979 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:54.697681 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-67585c9e-bfcf-4502-a61c-d132e3ade979 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:54.698656 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-67585c9e-bfcf-4502-a61c-d132e3ade979 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:54.699243 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-67585c9e-bfcf-4502-a61c-d132e3ade979 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:54.930039 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b2f72578-3771-48d3-b0b8-7cb0ca6be3f2 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:54.934386 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-67585c9e-bfcf-4502-a61c-d132e3ade979 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:54.942853 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-67585c9e-bfcf-4502-a61c-d132e3ade979 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1566 microversion: 2.1 time: 0.265496 Dec 15 16:23:54.943169 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b2f72578-3771-48d3-b0b8-7cb0ca6be3f2 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10" status: 200 len: 1317 microversion: 2.1 time: 0.278939 Dec 15 16:23:54.943490 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 195/399] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:54 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1566 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:54.944801 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 205/400] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:54 2021] GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10 => generated 1317 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:55.704875 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-2a6d8b3b-985b-435a-8a20-8c229030bde6 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:55.705514 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-2a6d8b3b-985b-435a-8a20-8c229030bde6 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:55.715516 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2a6d8b3b-985b-435a-8a20-8c229030bde6 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:55.715960 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2a6d8b3b-985b-435a-8a20-8c229030bde6 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:55.716754 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2a6d8b3b-985b-435a-8a20-8c229030bde6 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:55.717183 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2a6d8b3b-985b-435a-8a20-8c229030bde6 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:55.877545 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-2a6d8b3b-985b-435a-8a20-8c229030bde6 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b554f95b7b4444ab70e9dabf8197de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fc732badb0488392694e6d6c67d5dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:55.885913 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-2a6d8b3b-985b-435a-8a20-8c229030bde6 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d" status: 200 len: 1260 microversion: 2.1 time: 0.186320 Dec 15 16:23:55.886727 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 196/401] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:55 2021] GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d => generated 1260 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:55.961904 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ab8c2b8a-4ff6-4fd6-99a9-74d0364f3eb5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:55.962486 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ab8c2b8a-4ff6-4fd6-99a9-74d0364f3eb5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:55.965965 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-99b3ccdf-0ab3-448a-b03c-25738a43a725 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:55.966692 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-99b3ccdf-0ab3-448a-b03c-25738a43a725 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: cb018278-058e-41ee-8bdd-fded5c98ca10] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:55.970477 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ab8c2b8a-4ff6-4fd6-99a9-74d0364f3eb5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:55.976743 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ab8c2b8a-4ff6-4fd6-99a9-74d0364f3eb5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:55.976743 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ab8c2b8a-4ff6-4fd6-99a9-74d0364f3eb5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:55.976743 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ab8c2b8a-4ff6-4fd6-99a9-74d0364f3eb5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:55.979789 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-99b3ccdf-0ab3-448a-b03c-25738a43a725 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:55.980243 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-99b3ccdf-0ab3-448a-b03c-25738a43a725 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:55.981055 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-99b3ccdf-0ab3-448a-b03c-25738a43a725 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:55.990998 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-99b3ccdf-0ab3-448a-b03c-25738a43a725 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:56.206466 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ab8c2b8a-4ff6-4fd6-99a9-74d0364f3eb5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:56.209144 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-99b3ccdf-0ab3-448a-b03c-25738a43a725 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:56.214572 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ab8c2b8a-4ff6-4fd6-99a9-74d0364f3eb5 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1566 microversion: 2.1 time: 0.257318 Dec 15 16:23:56.215312 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 206/402] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:55 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1566 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:56.217012 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-99b3ccdf-0ab3-448a-b03c-25738a43a725 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10" status: 200 len: 1317 microversion: 2.1 time: 0.255012 Dec 15 16:23:56.218576 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 197/403] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:55 2021] GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10 => generated 1317 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:23:56.912288 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ad9245d1-5355-4087-a6f2-4fa5b1002ba7 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:56.913474 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ad9245d1-5355-4087-a6f2-4fa5b1002ba7 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:56.924782 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ad9245d1-5355-4087-a6f2-4fa5b1002ba7 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:56.925423 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ad9245d1-5355-4087-a6f2-4fa5b1002ba7 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:56.926487 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ad9245d1-5355-4087-a6f2-4fa5b1002ba7 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:56.927239 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ad9245d1-5355-4087-a6f2-4fa5b1002ba7 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:57.086221 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ad9245d1-5355-4087-a6f2-4fa5b1002ba7 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b554f95b7b4444ab70e9dabf8197de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fc732badb0488392694e6d6c67d5dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:57.094257 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ad9245d1-5355-4087-a6f2-4fa5b1002ba7 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d" status: 200 len: 1260 microversion: 2.1 time: 0.193163 Dec 15 16:23:57.094920 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 207/404] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:56 2021] GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d => generated 1260 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:23:57.234996 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-95eefa18-7e74-4614-8275-ae26dd5a424b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:57.235238 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-13c3952c-574c-4fd5-a6b4-837894d7e06f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:57.235810 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-95eefa18-7e74-4614-8275-ae26dd5a424b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: cb018278-058e-41ee-8bdd-fded5c98ca10] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:57.235948 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-13c3952c-574c-4fd5-a6b4-837894d7e06f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:57.242695 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-95eefa18-7e74-4614-8275-ae26dd5a424b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:57.243234 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-95eefa18-7e74-4614-8275-ae26dd5a424b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:57.244233 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-95eefa18-7e74-4614-8275-ae26dd5a424b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:57.244741 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-95eefa18-7e74-4614-8275-ae26dd5a424b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:57.245039 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-13c3952c-574c-4fd5-a6b4-837894d7e06f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:57.245493 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-13c3952c-574c-4fd5-a6b4-837894d7e06f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:57.246303 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-13c3952c-574c-4fd5-a6b4-837894d7e06f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:57.246721 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-13c3952c-574c-4fd5-a6b4-837894d7e06f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:57.467048 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-95eefa18-7e74-4614-8275-ae26dd5a424b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:57.471115 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-13c3952c-574c-4fd5-a6b4-837894d7e06f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:57.475723 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-95eefa18-7e74-4614-8275-ae26dd5a424b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10" status: 200 len: 1317 microversion: 2.1 time: 0.244383 Dec 15 16:23:57.476337 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 208/405] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:57 2021] GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10 => generated 1317 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:57.481757 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-13c3952c-574c-4fd5-a6b4-837894d7e06f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1566 microversion: 2.1 time: 0.250537 Dec 15 16:23:57.482589 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 198/406] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:57 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1566 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:58.116022 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-42949153-f7d8-4503-a647-e5e72aa666e6 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:58.117040 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-42949153-f7d8-4503-a647-e5e72aa666e6 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:58.131522 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-42949153-f7d8-4503-a647-e5e72aa666e6 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:58.132003 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-42949153-f7d8-4503-a647-e5e72aa666e6 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:58.132902 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-42949153-f7d8-4503-a647-e5e72aa666e6 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:58.133398 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-42949153-f7d8-4503-a647-e5e72aa666e6 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:58.295342 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-42949153-f7d8-4503-a647-e5e72aa666e6 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b554f95b7b4444ab70e9dabf8197de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fc732badb0488392694e6d6c67d5dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:58.308506 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-42949153-f7d8-4503-a647-e5e72aa666e6 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d" status: 200 len: 1260 microversion: 2.1 time: 0.197616 Dec 15 16:23:58.309500 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 209/407] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:58 2021] GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d => generated 1260 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:58.494433 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-d46344c7-6bb9-41fc-8565-a81104c345c7 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:58.495734 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-d46344c7-6bb9-41fc-8565-a81104c345c7 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: cb018278-058e-41ee-8bdd-fded5c98ca10] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:58.504060 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d46344c7-6bb9-41fc-8565-a81104c345c7 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:58.505180 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d46344c7-6bb9-41fc-8565-a81104c345c7 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:58.506240 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d46344c7-6bb9-41fc-8565-a81104c345c7 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:58.506715 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-26c040db-bdb5-493d-8769-1b1bfb85dca7 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:58.507198 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d46344c7-6bb9-41fc-8565-a81104c345c7 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:58.508570 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-26c040db-bdb5-493d-8769-1b1bfb85dca7 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:58.523861 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-26c040db-bdb5-493d-8769-1b1bfb85dca7 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:58.524316 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-26c040db-bdb5-493d-8769-1b1bfb85dca7 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:58.533123 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-26c040db-bdb5-493d-8769-1b1bfb85dca7 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:58.533577 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-26c040db-bdb5-493d-8769-1b1bfb85dca7 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:58.751283 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-d46344c7-6bb9-41fc-8565-a81104c345c7 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:58.759409 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-26c040db-bdb5-493d-8769-1b1bfb85dca7 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:58.760622 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-d46344c7-6bb9-41fc-8565-a81104c345c7 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10" status: 200 len: 1317 microversion: 2.1 time: 0.270031 Dec 15 16:23:58.764546 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 199/408] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:58 2021] GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10 => generated 1317 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:58.769503 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-26c040db-bdb5-493d-8769-1b1bfb85dca7 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1566 microversion: 2.1 time: 0.272530 Dec 15 16:23:58.770107 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 210/409] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:58 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1566 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:59.333859 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-633c7dd8-a450-4c65-bb2c-902aa5c22180 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:59.334473 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-633c7dd8-a450-4c65-bb2c-902aa5c22180 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:59.342784 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-633c7dd8-a450-4c65-bb2c-902aa5c22180 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:59.343392 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-633c7dd8-a450-4c65-bb2c-902aa5c22180 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:59.344424 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-633c7dd8-a450-4c65-bb2c-902aa5c22180 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:59.344890 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-633c7dd8-a450-4c65-bb2c-902aa5c22180 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:59.504192 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-633c7dd8-a450-4c65-bb2c-902aa5c22180 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b554f95b7b4444ab70e9dabf8197de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fc732badb0488392694e6d6c67d5dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:23:59.512464 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-633c7dd8-a450-4c65-bb2c-902aa5c22180 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d" status: 200 len: 1260 microversion: 2.1 time: 0.182936 Dec 15 16:23:59.513057 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 200/410] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:59 2021] GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d => generated 1260 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:23:59.784771 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-a61561f4-7b22-42a2-b576-e2eee2fe6d76 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:59.785633 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-a61561f4-7b22-42a2-b576-e2eee2fe6d76 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: cb018278-058e-41ee-8bdd-fded5c98ca10] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:59.794604 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-f9cf231c-0e77-4b57-b8fc-f9087dba408c tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:23:59.795431 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-f9cf231c-0e77-4b57-b8fc-f9087dba408c tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:23:59.805980 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f9cf231c-0e77-4b57-b8fc-f9087dba408c tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:59.806807 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f9cf231c-0e77-4b57-b8fc-f9087dba408c tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:59.809214 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f9cf231c-0e77-4b57-b8fc-f9087dba408c tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:59.809699 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f9cf231c-0e77-4b57-b8fc-f9087dba408c tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:59.818606 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a61561f4-7b22-42a2-b576-e2eee2fe6d76 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:59.819064 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a61561f4-7b22-42a2-b576-e2eee2fe6d76 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:23:59.819941 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a61561f4-7b22-42a2-b576-e2eee2fe6d76 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:23:59.820382 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a61561f4-7b22-42a2-b576-e2eee2fe6d76 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:00.026572 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-f9cf231c-0e77-4b57-b8fc-f9087dba408c tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:00.029313 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-a61561f4-7b22-42a2-b576-e2eee2fe6d76 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:00.040115 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-f9cf231c-0e77-4b57-b8fc-f9087dba408c tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1566 microversion: 2.1 time: 0.250060 Dec 15 16:24:00.040931 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 201/411] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:59 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1566 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:24:00.045795 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-008da756-013d-40fe-891d-ff369aa9e2ba req-46ede159-7e27-48f8-9b1a-05c8b21647fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afd5ac96-daf3-4608-818c-190e076c2f6d", "name": "network-vif-plugged", "status": "completed", "tag": "7f96dd5b-86e2-412f-920f-6abc632fd890"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:24:00.048063 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:24:00.048063 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Dec 15 16:24:00.052016 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-a61561f4-7b22-42a2-b576-e2eee2fe6d76 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10" status: 200 len: 1317 microversion: 2.1 time: 0.271987 Dec 15 16:24:00.052687 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 211/412] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:23:59 2021] GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10 => generated 1317 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:00.055410 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-008da756-013d-40fe-891d-ff369aa9e2ba req-46ede159-7e27-48f8-9b1a-05c8b21647fc service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:00.055870 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-008da756-013d-40fe-891d-ff369aa9e2ba req-46ede159-7e27-48f8-9b1a-05c8b21647fc service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:00.067543 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-008da756-013d-40fe-891d-ff369aa9e2ba req-46ede159-7e27-48f8-9b1a-05c8b21647fc service nova] Creating event network-vif-plugged:7f96dd5b-86e2-412f-920f-6abc632fd890 for instance afd5ac96-daf3-4608-818c-190e076c2f6d on hv-cinder-81268 Dec 15 16:24:00.072571 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-008da756-013d-40fe-891d-ff369aa9e2ba req-46ede159-7e27-48f8-9b1a-05c8b21647fc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030296 Dec 15 16:24:00.073213 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 202/413] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:24:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:24:00.532218 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-5c709428-efe6-4404-ad2d-0a156adaf12b tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:00.532848 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-5c709428-efe6-4404-ad2d-0a156adaf12b tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:00.539701 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5c709428-efe6-4404-ad2d-0a156adaf12b tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:00.540153 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5c709428-efe6-4404-ad2d-0a156adaf12b tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:00.540953 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5c709428-efe6-4404-ad2d-0a156adaf12b tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:00.541387 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5c709428-efe6-4404-ad2d-0a156adaf12b tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:00.694861 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-5c709428-efe6-4404-ad2d-0a156adaf12b tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b554f95b7b4444ab70e9dabf8197de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fc732badb0488392694e6d6c67d5dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:00.704566 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-5c709428-efe6-4404-ad2d-0a156adaf12b tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d" status: 200 len: 1260 microversion: 2.1 time: 0.178189 Dec 15 16:24:00.705621 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 212/414] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:00 2021] GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d => generated 1260 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:01.059153 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-0e0e467f-e6f3-4e0d-93a8-59f29fe8e59b tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:01.059918 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-0e0e467f-e6f3-4e0d-93a8-59f29fe8e59b tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:01.066888 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0e0e467f-e6f3-4e0d-93a8-59f29fe8e59b tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:01.067352 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0e0e467f-e6f3-4e0d-93a8-59f29fe8e59b tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:01.068179 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0e0e467f-e6f3-4e0d-93a8-59f29fe8e59b tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:01.068609 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0e0e467f-e6f3-4e0d-93a8-59f29fe8e59b tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:01.069423 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-7ac84f40-29d8-4d97-8b9f-41200c437cf8 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:01.070029 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-7ac84f40-29d8-4d97-8b9f-41200c437cf8 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: cb018278-058e-41ee-8bdd-fded5c98ca10] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:01.076722 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7ac84f40-29d8-4d97-8b9f-41200c437cf8 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:01.077169 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7ac84f40-29d8-4d97-8b9f-41200c437cf8 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:01.077951 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7ac84f40-29d8-4d97-8b9f-41200c437cf8 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:01.079111 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7ac84f40-29d8-4d97-8b9f-41200c437cf8 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:01.280388 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-0e0e467f-e6f3-4e0d-93a8-59f29fe8e59b tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:01.287902 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-7ac84f40-29d8-4d97-8b9f-41200c437cf8 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:01.297863 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-0e0e467f-e6f3-4e0d-93a8-59f29fe8e59b tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1566 microversion: 2.1 time: 0.242868 Dec 15 16:24:01.300768 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 203/415] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:01 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1566 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:01.305756 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-7ac84f40-29d8-4d97-8b9f-41200c437cf8 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10" status: 200 len: 1317 microversion: 2.1 time: 0.239135 Dec 15 16:24:01.307954 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 213/416] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:01 2021] GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10 => generated 1317 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:01.727388 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-bb1ec897-0c9b-417b-a885-8bdabfa73be7 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:01.727892 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-bb1ec897-0c9b-417b-a885-8bdabfa73be7 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:01.736654 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bb1ec897-0c9b-417b-a885-8bdabfa73be7 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:01.737110 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bb1ec897-0c9b-417b-a885-8bdabfa73be7 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:01.738024 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bb1ec897-0c9b-417b-a885-8bdabfa73be7 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:01.738543 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bb1ec897-0c9b-417b-a885-8bdabfa73be7 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:01.950025 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-bb1ec897-0c9b-417b-a885-8bdabfa73be7 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b554f95b7b4444ab70e9dabf8197de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fc732badb0488392694e6d6c67d5dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:01.958131 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-bb1ec897-0c9b-417b-a885-8bdabfa73be7 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d" status: 200 len: 1443 microversion: 2.1 time: 0.235154 Dec 15 16:24:01.958918 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 204/417] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:01 2021] GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d => generated 1443 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:01.987347 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-aae753a6-4ff5-49ef-9554-43f2a5156bd4 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:01.988389 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-aae753a6-4ff5-49ef-9554-43f2a5156bd4 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:01.998793 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-aae753a6-4ff5-49ef-9554-43f2a5156bd4 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:01.999552 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-aae753a6-4ff5-49ef-9554-43f2a5156bd4 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:02.000924 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-aae753a6-4ff5-49ef-9554-43f2a5156bd4 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:02.001663 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-aae753a6-4ff5-49ef-9554-43f2a5156bd4 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:02.169238 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-aae753a6-4ff5-49ef-9554-43f2a5156bd4 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b554f95b7b4444ab70e9dabf8197de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fc732badb0488392694e6d6c67d5dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:02.178423 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-aae753a6-4ff5-49ef-9554-43f2a5156bd4 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d" status: 200 len: 1443 microversion: 2.1 time: 0.197784 Dec 15 16:24:02.179021 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 214/418] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:01 2021] GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d => generated 1443 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:24:02.323184 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-784ad8c1-684c-4eab-baa3-f996692b7308 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:02.323848 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-784ad8c1-684c-4eab-baa3-f996692b7308 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:02.333536 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c624baea-b1a7-470c-a568-3cf77dee1722 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:02.336920 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c624baea-b1a7-470c-a568-3cf77dee1722 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: cb018278-058e-41ee-8bdd-fded5c98ca10] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:02.340723 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-784ad8c1-684c-4eab-baa3-f996692b7308 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:02.341185 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-784ad8c1-684c-4eab-baa3-f996692b7308 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:02.342200 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-784ad8c1-684c-4eab-baa3-f996692b7308 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:02.342684 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-784ad8c1-684c-4eab-baa3-f996692b7308 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:02.352030 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c624baea-b1a7-470c-a568-3cf77dee1722 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:02.352429 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c624baea-b1a7-470c-a568-3cf77dee1722 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:02.353702 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c624baea-b1a7-470c-a568-3cf77dee1722 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:02.354249 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c624baea-b1a7-470c-a568-3cf77dee1722 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:02.852089 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-c624baea-b1a7-470c-a568-3cf77dee1722 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:02.855574 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-784ad8c1-684c-4eab-baa3-f996692b7308 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:02.863103 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c624baea-b1a7-470c-a568-3cf77dee1722 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10" status: 200 len: 1317 microversion: 2.1 time: 0.537343 Dec 15 16:24:02.864980 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-784ad8c1-684c-4eab-baa3-f996692b7308 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1566 microversion: 2.1 time: 0.545355 Dec 15 16:24:02.866995 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 215/419] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:02 2021] GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10 => generated 1317 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:02.873996 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 205/420] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:02 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1566 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:03.882281 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d25f435a-73a6-4d86-847c-316e0948e4f1 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:03.883182 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d25f435a-73a6-4d86-847c-316e0948e4f1 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:03.892714 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-ff6e1483-990e-4e6f-8b5a-f7cdb241d09e tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:03.893602 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-ff6e1483-990e-4e6f-8b5a-f7cdb241d09e tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: cb018278-058e-41ee-8bdd-fded5c98ca10] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:03.902033 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d25f435a-73a6-4d86-847c-316e0948e4f1 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:03.903471 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d25f435a-73a6-4d86-847c-316e0948e4f1 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:03.905246 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ff6e1483-990e-4e6f-8b5a-f7cdb241d09e tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:03.906354 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ff6e1483-990e-4e6f-8b5a-f7cdb241d09e tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:03.907384 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ff6e1483-990e-4e6f-8b5a-f7cdb241d09e tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:03.908886 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d25f435a-73a6-4d86-847c-316e0948e4f1 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:03.909458 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ff6e1483-990e-4e6f-8b5a-f7cdb241d09e tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:03.910496 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d25f435a-73a6-4d86-847c-316e0948e4f1 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:04.272081 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d25f435a-73a6-4d86-847c-316e0948e4f1 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:04.284573 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d25f435a-73a6-4d86-847c-316e0948e4f1 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1566 microversion: 2.1 time: 0.406521 Dec 15 16:24:04.285336 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 216/421] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:03 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1566 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:04.286168 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-ff6e1483-990e-4e6f-8b5a-f7cdb241d09e tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:04.294387 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-ff6e1483-990e-4e6f-8b5a-f7cdb241d09e tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10" status: 200 len: 1317 microversion: 2.1 time: 0.405440 Dec 15 16:24:04.294982 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 206/422] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:03 2021] GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10 => generated 1317 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:24:05.311002 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-989a18aa-d5d8-4dfc-ae9c-cc0664b056bf tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:05.311804 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-989a18aa-d5d8-4dfc-ae9c-cc0664b056bf tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:05.320454 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-9ca5a30a-cc12-4050-aa15-959224e5e74d tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:05.321802 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-9ca5a30a-cc12-4050-aa15-959224e5e74d tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: cb018278-058e-41ee-8bdd-fded5c98ca10] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:05.330034 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9ca5a30a-cc12-4050-aa15-959224e5e74d tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:05.330487 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9ca5a30a-cc12-4050-aa15-959224e5e74d tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:05.331325 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9ca5a30a-cc12-4050-aa15-959224e5e74d tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:05.332458 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9ca5a30a-cc12-4050-aa15-959224e5e74d tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:05.357385 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-989a18aa-d5d8-4dfc-ae9c-cc0664b056bf tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:05.358379 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-989a18aa-d5d8-4dfc-ae9c-cc0664b056bf tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:05.360494 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-989a18aa-d5d8-4dfc-ae9c-cc0664b056bf tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:05.361194 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-989a18aa-d5d8-4dfc-ae9c-cc0664b056bf tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:05.613165 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-989a18aa-d5d8-4dfc-ae9c-cc0664b056bf tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:05.616305 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-9ca5a30a-cc12-4050-aa15-959224e5e74d tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:05.624192 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-989a18aa-d5d8-4dfc-ae9c-cc0664b056bf tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1546 microversion: 2.1 time: 0.317605 Dec 15 16:24:05.637196 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 217/423] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:05 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1546 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:05.637415 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-9ca5a30a-cc12-4050-aa15-959224e5e74d tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10" status: 200 len: 1317 microversion: 2.1 time: 0.309616 Dec 15 16:24:05.637515 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-af50d9ab-8709-443b-a2fb-06e80fd8af21 req-de09e0e9-d47a-42bc-a312-c8a7dace94ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afd5ac96-daf3-4608-818c-190e076c2f6d", "tag": "7f96dd5b-86e2-412f-920f-6abc632fd890"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:24:05.637515 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:24:05.637515 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:24:05.640374 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-af50d9ab-8709-443b-a2fb-06e80fd8af21 req-de09e0e9-d47a-42bc-a312-c8a7dace94ef service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:05.641280 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-af50d9ab-8709-443b-a2fb-06e80fd8af21 req-de09e0e9-d47a-42bc-a312-c8a7dace94ef service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:05.642201 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 207/424] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:05 2021] GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10 => generated 1317 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:24:05.647289 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-8ca993ed-45f5-42f4-b35d-2718cbdbf3c1 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:05.648026 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-8ca993ed-45f5-42f4-b35d-2718cbdbf3c1 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:05.654626 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-af50d9ab-8709-443b-a2fb-06e80fd8af21 req-de09e0e9-d47a-42bc-a312-c8a7dace94ef service nova] Creating event network-changed:7f96dd5b-86e2-412f-920f-6abc632fd890 for instance afd5ac96-daf3-4608-818c-190e076c2f6d on hv-cinder-81268 Dec 15 16:24:05.654819 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8ca993ed-45f5-42f4-b35d-2718cbdbf3c1 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:05.655222 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8ca993ed-45f5-42f4-b35d-2718cbdbf3c1 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:05.656191 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8ca993ed-45f5-42f4-b35d-2718cbdbf3c1 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:05.656671 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8ca993ed-45f5-42f4-b35d-2718cbdbf3c1 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:05.662039 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-af50d9ab-8709-443b-a2fb-06e80fd8af21 req-de09e0e9-d47a-42bc-a312-c8a7dace94ef service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034987 Dec 15 16:24:05.662654 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 218/425] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:24:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:24:05.765914 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.wsgi [None req-8ca993ed-45f5-42f4-b35d-2718cbdbf3c1 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] HTTP exception thrown: Cannot 'detach_volume' instance 129b3afd-1d85-4f6e-94c3-8e7a729ff532 while it is in vm_state rescued Dec 15 16:24:05.766168 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-8ca993ed-45f5-42f4-b35d-2718cbdbf3c1 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Returning 409 to user: Cannot 'detach_volume' instance 129b3afd-1d85-4f6e-94c3-8e7a729ff532 while it is in vm_state rescued {{(pid=116085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:24:05.767240 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-8ca993ed-45f5-42f4-b35d-2718cbdbf3c1 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "DELETE /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532/os-volume_attachments/63380b50-7c61-4411-a23a-7ebf8d15fb49" status: 409 len: 152 microversion: 2.1 time: 0.123625 Dec 15 16:24:05.767991 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 208/426] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Dec 15 16:24:05 2021] DELETE /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532/os-volume_attachments/63380b50-7c61-4411-a23a-7ebf8d15fb49 => generated 152 bytes in 125 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 15 16:24:05.779422 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f49b183d-f7e0-4af4-8839-bdad71791045 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:24:05.780055 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f49b183d-f7e0-4af4-8839-bdad71791045 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:05.787988 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f49b183d-f7e0-4af4-8839-bdad71791045 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:05.788434 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f49b183d-f7e0-4af4-8839-bdad71791045 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:05.789360 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f49b183d-f7e0-4af4-8839-bdad71791045 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:05.789669 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f49b183d-f7e0-4af4-8839-bdad71791045 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:05.924632 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f49b183d-f7e0-4af4-8839-bdad71791045 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "POST /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532/action" status: 202 len: 0 microversion: 2.1 time: 0.149251 Dec 15 16:24:05.942758 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-63e47c7e-febc-4d8b-b965-a59a2f666e6e tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:05.943358 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-63e47c7e-febc-4d8b-b965-a59a2f666e6e tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:05.950376 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 219/427] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:24:05 2021] POST /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:24:05.958539 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-63e47c7e-febc-4d8b-b965-a59a2f666e6e tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:05.960074 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-63e47c7e-febc-4d8b-b965-a59a2f666e6e tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:05.962224 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-63e47c7e-febc-4d8b-b965-a59a2f666e6e tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:05.964556 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-63e47c7e-febc-4d8b-b965-a59a2f666e6e tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:06.219827 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-63e47c7e-febc-4d8b-b965-a59a2f666e6e tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:06.231900 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-63e47c7e-febc-4d8b-b965-a59a2f666e6e tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1554 microversion: 2.1 time: 0.300122 Dec 15 16:24:06.232941 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 209/428] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:05 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1554 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:24:06.650889 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e10354a1-4585-40f6-b7c5-9aff6fb51ffa tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:06.651643 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e10354a1-4585-40f6-b7c5-9aff6fb51ffa tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: cb018278-058e-41ee-8bdd-fded5c98ca10] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:06.662768 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e10354a1-4585-40f6-b7c5-9aff6fb51ffa tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:06.663212 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e10354a1-4585-40f6-b7c5-9aff6fb51ffa tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:06.664029 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e10354a1-4585-40f6-b7c5-9aff6fb51ffa tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:06.664454 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e10354a1-4585-40f6-b7c5-9aff6fb51ffa tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:06.902371 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e10354a1-4585-40f6-b7c5-9aff6fb51ffa tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:06.912328 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e10354a1-4585-40f6-b7c5-9aff6fb51ffa tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10" status: 200 len: 1317 microversion: 2.1 time: 0.265908 Dec 15 16:24:06.912910 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 220/429] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:06 2021] GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10 => generated 1317 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:07.250656 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-aadcab8b-bb54-40c3-b154-2c5b2031c0d1 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:07.252058 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-aadcab8b-bb54-40c3-b154-2c5b2031c0d1 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:07.258987 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-aadcab8b-bb54-40c3-b154-2c5b2031c0d1 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:07.259678 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-aadcab8b-bb54-40c3-b154-2c5b2031c0d1 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:07.260468 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-aadcab8b-bb54-40c3-b154-2c5b2031c0d1 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:07.261807 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-aadcab8b-bb54-40c3-b154-2c5b2031c0d1 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:07.464556 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-aadcab8b-bb54-40c3-b154-2c5b2031c0d1 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:07.473082 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-aadcab8b-bb54-40c3-b154-2c5b2031c0d1 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1554 microversion: 2.1 time: 0.226204 Dec 15 16:24:07.474084 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 210/430] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:07 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1554 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:07.932239 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-84e62059-c9ef-478a-8568-3ad798297446 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:07.933407 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-84e62059-c9ef-478a-8568-3ad798297446 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: cb018278-058e-41ee-8bdd-fded5c98ca10] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:07.941776 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-84e62059-c9ef-478a-8568-3ad798297446 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:07.942205 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-84e62059-c9ef-478a-8568-3ad798297446 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:07.943020 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-84e62059-c9ef-478a-8568-3ad798297446 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:07.943496 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-84e62059-c9ef-478a-8568-3ad798297446 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:08.087503 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-84e62059-c9ef-478a-8568-3ad798297446 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:08.095128 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-84e62059-c9ef-478a-8568-3ad798297446 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10" status: 200 len: 1317 microversion: 2.1 time: 0.169076 Dec 15 16:24:08.095779 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 221/431] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:07 2021] GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:08.499267 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-48671ec5-5454-4326-8321-a80fdc893e49 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:08.499915 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-48671ec5-5454-4326-8321-a80fdc893e49 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:08.508197 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-48671ec5-5454-4326-8321-a80fdc893e49 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:08.508673 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-48671ec5-5454-4326-8321-a80fdc893e49 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:08.509581 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-48671ec5-5454-4326-8321-a80fdc893e49 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:08.510115 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-48671ec5-5454-4326-8321-a80fdc893e49 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:08.661962 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-48671ec5-5454-4326-8321-a80fdc893e49 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:08.670362 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-48671ec5-5454-4326-8321-a80fdc893e49 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1554 microversion: 2.1 time: 0.174655 Dec 15 16:24:08.671269 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 211/432] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:08 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1554 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:09.114236 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-929335c4-b820-487c-8652-b1aede5b0b76 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:09.114895 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-929335c4-b820-487c-8652-b1aede5b0b76 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: cb018278-058e-41ee-8bdd-fded5c98ca10] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:09.122035 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-929335c4-b820-487c-8652-b1aede5b0b76 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:09.122458 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-929335c4-b820-487c-8652-b1aede5b0b76 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:09.123278 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-929335c4-b820-487c-8652-b1aede5b0b76 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:09.123744 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-929335c4-b820-487c-8652-b1aede5b0b76 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:09.282675 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-929335c4-b820-487c-8652-b1aede5b0b76 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:09.294085 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-929335c4-b820-487c-8652-b1aede5b0b76 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10" status: 200 len: 1317 microversion: 2.1 time: 0.184212 Dec 15 16:24:09.295071 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 222/433] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:09 2021] GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10 => generated 1317 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:09.689081 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-e2ff89f9-a2b9-4772-9f62-e23fcbc48465 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:09.689893 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-e2ff89f9-a2b9-4772-9f62-e23fcbc48465 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:09.696889 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e2ff89f9-a2b9-4772-9f62-e23fcbc48465 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:09.697370 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e2ff89f9-a2b9-4772-9f62-e23fcbc48465 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:09.698170 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e2ff89f9-a2b9-4772-9f62-e23fcbc48465 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:09.698606 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e2ff89f9-a2b9-4772-9f62-e23fcbc48465 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:09.889623 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-e2ff89f9-a2b9-4772-9f62-e23fcbc48465 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:09.903733 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-e2ff89f9-a2b9-4772-9f62-e23fcbc48465 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1560 microversion: 2.1 time: 0.218289 Dec 15 16:24:09.916549 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 212/434] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:09 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1560 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:10.002557 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-4f7c0761-c7f3-4b77-b5d8-196e00c8d93a tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:10.003331 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-4f7c0761-c7f3-4b77-b5d8-196e00c8d93a tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:10.009942 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4f7c0761-c7f3-4b77-b5d8-196e00c8d93a tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:10.010471 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4f7c0761-c7f3-4b77-b5d8-196e00c8d93a tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:10.011462 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4f7c0761-c7f3-4b77-b5d8-196e00c8d93a tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:10.012054 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4f7c0761-c7f3-4b77-b5d8-196e00c8d93a tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:10.026160 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-83319486-20eb-45de-b3c0-590dd69a2a64 req-4b1ed9b3-3a9d-4242-bb0d-d2d6d48eaac6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb018278-058e-41ee-8bdd-fded5c98ca10", "name": "network-vif-plugged", "status": "completed", "tag": "b966396f-ab45-4ab1-a379-55a0bbe41429"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:24:10.028231 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:24:10.028231 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Dec 15 16:24:10.037804 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-83319486-20eb-45de-b3c0-590dd69a2a64 req-4b1ed9b3-3a9d-4242-bb0d-d2d6d48eaac6 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:10.038436 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-83319486-20eb-45de-b3c0-590dd69a2a64 req-4b1ed9b3-3a9d-4242-bb0d-d2d6d48eaac6 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:10.052930 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-83319486-20eb-45de-b3c0-590dd69a2a64 req-4b1ed9b3-3a9d-4242-bb0d-d2d6d48eaac6 service nova] Creating event network-vif-plugged:b966396f-ab45-4ab1-a379-55a0bbe41429 for instance cb018278-058e-41ee-8bdd-fded5c98ca10 on hv-cinder-81268 Dec 15 16:24:10.058373 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-83319486-20eb-45de-b3c0-590dd69a2a64 req-4b1ed9b3-3a9d-4242-bb0d-d2d6d48eaac6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035849 Dec 15 16:24:10.060243 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 213/435] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:24:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:24:10.173601 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.objects.instance [None req-4f7c0761-c7f3-4b77-b5d8-196e00c8d93a tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lazy-loading 'services' on Instance uuid 129b3afd-1d85-4f6e-94c3-8e7a729ff532 {{(pid=116084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:24:10.303563 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-4f7c0761-c7f3-4b77-b5d8-196e00c8d93a tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "DELETE /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532/os-volume_attachments/63380b50-7c61-4411-a23a-7ebf8d15fb49" status: 202 len: 0 microversion: 2.1 time: 0.305261 Dec 15 16:24:10.307887 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 223/436] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Dec 15 16:24:09 2021] DELETE /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532/os-volume_attachments/63380b50-7c61-4411-a23a-7ebf8d15fb49 => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:24:10.320184 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-54b3a3b4-3a70-4310-8a8f-b002cae6231d tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:10.322997 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-54b3a3b4-3a70-4310-8a8f-b002cae6231d tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:10.335348 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-54b3a3b4-3a70-4310-8a8f-b002cae6231d tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:10.335348 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-54b3a3b4-3a70-4310-8a8f-b002cae6231d tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:10.335833 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-54b3a3b4-3a70-4310-8a8f-b002cae6231d tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:10.336428 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-54b3a3b4-3a70-4310-8a8f-b002cae6231d tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:10.356461 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-cc9fc361-18a9-4770-8e5a-c3365a551a4b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:10.360591 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-cc9fc361-18a9-4770-8e5a-c3365a551a4b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: cb018278-058e-41ee-8bdd-fded5c98ca10] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:10.370113 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cc9fc361-18a9-4770-8e5a-c3365a551a4b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:10.370776 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cc9fc361-18a9-4770-8e5a-c3365a551a4b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:10.371799 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cc9fc361-18a9-4770-8e5a-c3365a551a4b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:10.372511 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cc9fc361-18a9-4770-8e5a-c3365a551a4b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:10.382769 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-54b3a3b4-3a70-4310-8a8f-b002cae6231d tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071748 Dec 15 16:24:10.388485 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 214/437] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Dec 15 16:24:10 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:24:10.588546 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-cc9fc361-18a9-4770-8e5a-c3365a551a4b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:10.596920 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-cc9fc361-18a9-4770-8e5a-c3365a551a4b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10" status: 200 len: 1317 microversion: 2.1 time: 0.266302 Dec 15 16:24:10.598405 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 224/438] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:10 2021] GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10 => generated 1317 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:24:10.708142 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-9fe3ace3-67d2-4f46-8cb9-516878d6521d tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-270813205", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1448152906", "security_groups": [{"name": "tempest-secgroup-smoke-26496151"}], "block_device_mapping_v2": [{"uuid": "cee42b5e-bb41-4077-a28c-9aa499da5df2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fa64c9a0-e96d-42b2-b777-1875ab6b3322"}]}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:24:10.863146 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.network.neutron [None req-9fe3ace3-67d2-4f46-8cb9-516878d6521d tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] validate_networks() for [('fa64c9a0-e96d-42b2-b777-1875ab6b3322', None, None, None, None, None)] {{(pid=116085) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:24:11.375387 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-9fe3ace3-67d2-4f46-8cb9-516878d6521d tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Flavor limits 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:24:11.375944 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-9fe3ace3-67d2-4f46-8cb9-516878d6521d tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Image limits 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:24:11.376464 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-9fe3ace3-67d2-4f46-8cb9-516878d6521d tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Flavor pref 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:24:11.376857 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-9fe3ace3-67d2-4f46-8cb9-516878d6521d tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Image pref 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:24:11.377259 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-9fe3ace3-67d2-4f46-8cb9-516878d6521d tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:24:11.388175 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9fe3ace3-67d2-4f46-8cb9-516878d6521d tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:11.388175 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9fe3ace3-67d2-4f46-8cb9-516878d6521d tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:11.390374 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9fe3ace3-67d2-4f46-8cb9-516878d6521d tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:11.390374 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9fe3ace3-67d2-4f46-8cb9-516878d6521d tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:11.398292 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c4c2302b-b085-4939-9e65-4cbb8e1a0d1d tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:11.399248 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c4c2302b-b085-4939-9e65-4cbb8e1a0d1d tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:11.418530 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-9fe3ace3-67d2-4f46-8cb9-516878d6521d tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Getting quotas for project 9fd32b6eee5e4a75b6dec0e216953bd4. Resources: {'cores', 'instances', 'ram'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:24:11.423654 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-9fe3ace3-67d2-4f46-8cb9-516878d6521d tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Getting quotas for user c46c8a697d044c8ba9b2c0e46c70c6e8 and project 9fd32b6eee5e4a75b6dec0e216953bd4. Resources: {'cores', 'instances', 'ram'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:24:11.425952 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c4c2302b-b085-4939-9e65-4cbb8e1a0d1d tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:11.426451 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c4c2302b-b085-4939-9e65-4cbb8e1a0d1d tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:11.427595 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c4c2302b-b085-4939-9e65-4cbb8e1a0d1d tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:11.428026 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c4c2302b-b085-4939-9e65-4cbb8e1a0d1d tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:11.481298 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c4c2302b-b085-4939-9e65-4cbb8e1a0d1d tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.086622 Dec 15 16:24:11.481872 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 225/439] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Dec 15 16:24:11 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532/os-volume_attachments => generated 25 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:24:11.511250 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-9fe3ace3-67d2-4f46-8cb9-516878d6521d tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Going to run 1 instances... {{(pid=116085) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:24:11.516144 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-9fe3ace3-67d2-4f46-8cb9-516878d6521d tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] [instance: 866ffde4-7bbe-4e59-8cdd-eba253d24fc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cee42b5e-bb41-4077-a28c-9aa499da5df2',volume_size=None,volume_type=None)] {{(pid=116085) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:24:11.616421 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0b97afd7-5228-47a4-b225-b32bcb9e303b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:11.617074 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-0b97afd7-5228-47a4-b225-b32bcb9e303b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: cb018278-058e-41ee-8bdd-fded5c98ca10] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:11.633001 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0b97afd7-5228-47a4-b225-b32bcb9e303b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:11.633815 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0b97afd7-5228-47a4-b225-b32bcb9e303b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:11.637163 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0b97afd7-5228-47a4-b225-b32bcb9e303b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:11.640467 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0b97afd7-5228-47a4-b225-b32bcb9e303b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:11.694678 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-9fe3ace3-67d2-4f46-8cb9-516878d6521d tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.990517 Dec 15 16:24:11.700794 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 215/440] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Dec 15 16:24:10 2021] POST /compute/v2.1/servers => generated 404 bytes in 997 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 16:24:11.706628 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-0fca8497-ef3b-416a-b970-f3d7b0632748 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:11.707383 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-0fca8497-ef3b-416a-b970-f3d7b0632748 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] [instance: 866ffde4-7bbe-4e59-8cdd-eba253d24fc7] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:11.886272 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-0fca8497-ef3b-416a-b970-f3d7b0632748 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c46c8a697d044c8ba9b2c0e46c70c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd32b6eee5e4a75b6dec0e216953bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:11.896368 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-0fca8497-ef3b-416a-b970-f3d7b0632748 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] 10.222.0.60 "GET /compute/v2.1/servers/866ffde4-7bbe-4e59-8cdd-eba253d24fc7" status: 200 len: 1094 microversion: 2.1 time: 0.194287 Dec 15 16:24:11.906317 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 216/441] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:11 2021] GET /compute/v2.1/servers/866ffde4-7bbe-4e59-8cdd-eba253d24fc7 => generated 1094 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:12.074715 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-0b97afd7-5228-47a4-b225-b32bcb9e303b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:12.083821 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0b97afd7-5228-47a4-b225-b32bcb9e303b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10" status: 200 len: 1317 microversion: 2.1 time: 0.472513 Dec 15 16:24:12.084424 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 226/442] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:11 2021] GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10 => generated 1317 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:12.918650 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-38645b98-e295-473c-9b9a-33687eab1383 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:12.919928 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-38645b98-e295-473c-9b9a-33687eab1383 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] [instance: 866ffde4-7bbe-4e59-8cdd-eba253d24fc7] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:12.931122 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-38645b98-e295-473c-9b9a-33687eab1383 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:12.931711 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-38645b98-e295-473c-9b9a-33687eab1383 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:12.932701 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-38645b98-e295-473c-9b9a-33687eab1383 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:12.933266 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-38645b98-e295-473c-9b9a-33687eab1383 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:13.051156 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-38645b98-e295-473c-9b9a-33687eab1383 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c46c8a697d044c8ba9b2c0e46c70c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd32b6eee5e4a75b6dec0e216953bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:13.061474 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-38645b98-e295-473c-9b9a-33687eab1383 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] 10.222.0.60 "GET /compute/v2.1/servers/866ffde4-7bbe-4e59-8cdd-eba253d24fc7" status: 200 len: 1192 microversion: 2.1 time: 0.148249 Dec 15 16:24:13.062784 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 217/443] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:12 2021] GET /compute/v2.1/servers/866ffde4-7bbe-4e59-8cdd-eba253d24fc7 => generated 1192 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:24:13.103126 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-242e731f-b2ac-4df2-b148-5fe06082442b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:13.105319 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-242e731f-b2ac-4df2-b148-5fe06082442b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: cb018278-058e-41ee-8bdd-fded5c98ca10] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:13.114549 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-242e731f-b2ac-4df2-b148-5fe06082442b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:13.119214 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-242e731f-b2ac-4df2-b148-5fe06082442b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:13.120182 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-242e731f-b2ac-4df2-b148-5fe06082442b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:13.120623 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-242e731f-b2ac-4df2-b148-5fe06082442b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:13.286390 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-242e731f-b2ac-4df2-b148-5fe06082442b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:13.294737 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-242e731f-b2ac-4df2-b148-5fe06082442b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10" status: 200 len: 1506 microversion: 2.1 time: 0.196724 Dec 15 16:24:13.295338 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 227/444] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:13 2021] GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10 => generated 1506 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:24:13.986240 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-7388a2fc-b155-459d-a58d-ce31c71b0e34 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:13.987720 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-7388a2fc-b155-459d-a58d-ce31c71b0e34 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: bb8ad3f4-a466-4385-9311-93476fe7304e] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:13.994835 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7388a2fc-b155-459d-a58d-ce31c71b0e34 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:13.995581 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7388a2fc-b155-459d-a58d-ce31c71b0e34 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:13.996643 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7388a2fc-b155-459d-a58d-ce31c71b0e34 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:13.997292 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7388a2fc-b155-459d-a58d-ce31c71b0e34 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:14.025338 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-7388a2fc-b155-459d-a58d-ce31c71b0e34 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: bb8ad3f4-a466-4385-9311-93476fe7304e] Going to try to terminate instance {{(pid=116085) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:24:14.091783 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-8aa36b7d-005e-46ad-b78e-53745aba7d22 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:14.092272 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-8aa36b7d-005e-46ad-b78e-53745aba7d22 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] [instance: 866ffde4-7bbe-4e59-8cdd-eba253d24fc7] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:14.099588 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8aa36b7d-005e-46ad-b78e-53745aba7d22 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:14.100121 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8aa36b7d-005e-46ad-b78e-53745aba7d22 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:14.100984 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8aa36b7d-005e-46ad-b78e-53745aba7d22 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:14.101726 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8aa36b7d-005e-46ad-b78e-53745aba7d22 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:14.120614 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-7388a2fc-b155-459d-a58d-ce31c71b0e34 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "DELETE /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e" status: 204 len: 0 microversion: 2.1 time: 0.137947 Dec 15 16:24:14.121729 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 218/445] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Dec 15 16:24:13 2021] DELETE /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 15 16:24:14.135254 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-017a0ecf-09f1-41a3-8280-6ef0c3d31388 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:14.136002 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-017a0ecf-09f1-41a3-8280-6ef0c3d31388 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: bb8ad3f4-a466-4385-9311-93476fe7304e] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:14.143302 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-017a0ecf-09f1-41a3-8280-6ef0c3d31388 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:14.143797 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-017a0ecf-09f1-41a3-8280-6ef0c3d31388 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:14.144821 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-017a0ecf-09f1-41a3-8280-6ef0c3d31388 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:14.145261 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-017a0ecf-09f1-41a3-8280-6ef0c3d31388 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:14.180212 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-8aa36b7d-005e-46ad-b78e-53745aba7d22 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c46c8a697d044c8ba9b2c0e46c70c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd32b6eee5e4a75b6dec0e216953bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:14.188750 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-8aa36b7d-005e-46ad-b78e-53745aba7d22 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] 10.222.0.60 "GET /compute/v2.1/servers/866ffde4-7bbe-4e59-8cdd-eba253d24fc7" status: 200 len: 1210 microversion: 2.1 time: 0.100764 Dec 15 16:24:14.198753 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 228/446] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:14 2021] GET /compute/v2.1/servers/866ffde4-7bbe-4e59-8cdd-eba253d24fc7 => generated 1210 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:14.316158 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-017a0ecf-09f1-41a3-8280-6ef0c3d31388 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:14.326240 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-017a0ecf-09f1-41a3-8280-6ef0c3d31388 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e" status: 200 len: 1506 microversion: 2.1 time: 0.195208 Dec 15 16:24:14.327422 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 219/447] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:14 2021] GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e => generated 1506 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:14.725110 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-2fd7bb6a-c9ef-401c-bff2-bc23b8a6750a tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "763a4360-8297-4fda-8b5d-5a78a0f4832a"}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:24:14.726253 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-2fd7bb6a-c9ef-401c-bff2-bc23b8a6750a tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: cb018278-058e-41ee-8bdd-fded5c98ca10] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:14.732941 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2fd7bb6a-c9ef-401c-bff2-bc23b8a6750a tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:14.733375 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2fd7bb6a-c9ef-401c-bff2-bc23b8a6750a tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:14.734203 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2fd7bb6a-c9ef-401c-bff2-bc23b8a6750a tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:14.734615 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2fd7bb6a-c9ef-401c-bff2-bc23b8a6750a tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:15.040844 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-2fd7bb6a-c9ef-401c-bff2-bc23b8a6750a tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "POST /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.319263 Dec 15 16:24:15.041647 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 229/448] 10.222.0.60 () {60 vars in 1322 bytes} [Wed Dec 15 16:24:14 2021] POST /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10/os-volume_attachments => generated 194 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:24:15.206454 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-8abb5b2d-85fe-4af9-a01e-a003347ce424 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:15.207047 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-8abb5b2d-85fe-4af9-a01e-a003347ce424 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] [instance: 866ffde4-7bbe-4e59-8cdd-eba253d24fc7] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:15.214873 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8abb5b2d-85fe-4af9-a01e-a003347ce424 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:15.215053 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8abb5b2d-85fe-4af9-a01e-a003347ce424 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:15.216126 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8abb5b2d-85fe-4af9-a01e-a003347ce424 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:15.216543 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8abb5b2d-85fe-4af9-a01e-a003347ce424 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:15.237512 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-903d1382-8513-4819-83bc-db37b6f0d43c req-8430a413-b5aa-454c-b91d-8855e26b4444 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "866ffde4-7bbe-4e59-8cdd-eba253d24fc7", "tag": "16ce5e62-cdd5-406c-956b-1916ae817f6a"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:24:15.239128 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:24:15.239128 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:24:15.256976 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-903d1382-8513-4819-83bc-db37b6f0d43c req-8430a413-b5aa-454c-b91d-8855e26b4444 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:15.257418 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-903d1382-8513-4819-83bc-db37b6f0d43c req-8430a413-b5aa-454c-b91d-8855e26b4444 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:15.287429 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-903d1382-8513-4819-83bc-db37b6f0d43c req-8430a413-b5aa-454c-b91d-8855e26b4444 service nova] Creating event network-changed:16ce5e62-cdd5-406c-956b-1916ae817f6a for instance 866ffde4-7bbe-4e59-8cdd-eba253d24fc7 on hv-cinder-81268 Dec 15 16:24:15.299699 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-903d1382-8513-4819-83bc-db37b6f0d43c req-8430a413-b5aa-454c-b91d-8855e26b4444 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074487 Dec 15 16:24:15.307014 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 230/449] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:24:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:24:15.347437 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e11b5ecd-e596-485d-93bf-72e306be4d74 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:15.348739 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e11b5ecd-e596-485d-93bf-72e306be4d74 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: bb8ad3f4-a466-4385-9311-93476fe7304e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:15.362059 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e11b5ecd-e596-485d-93bf-72e306be4d74 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:15.367835 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e11b5ecd-e596-485d-93bf-72e306be4d74 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:15.369367 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e11b5ecd-e596-485d-93bf-72e306be4d74 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:15.369367 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e11b5ecd-e596-485d-93bf-72e306be4d74 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:15.532735 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-8abb5b2d-85fe-4af9-a01e-a003347ce424 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c46c8a697d044c8ba9b2c0e46c70c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd32b6eee5e4a75b6dec0e216953bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:15.540495 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-8abb5b2d-85fe-4af9-a01e-a003347ce424 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] 10.222.0.60 "GET /compute/v2.1/servers/866ffde4-7bbe-4e59-8cdd-eba253d24fc7" status: 200 len: 1264 microversion: 2.1 time: 0.338032 Dec 15 16:24:15.541249 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 220/450] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:15 2021] GET /compute/v2.1/servers/866ffde4-7bbe-4e59-8cdd-eba253d24fc7 => generated 1264 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:15.606012 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e11b5ecd-e596-485d-93bf-72e306be4d74 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:15.621913 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e11b5ecd-e596-485d-93bf-72e306be4d74 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e" status: 200 len: 1506 microversion: 2.1 time: 0.279924 Dec 15 16:24:15.623811 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 231/451] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:15 2021] GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e => generated 1506 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:16.558647 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-a9838968-8134-46e5-80ee-8a08fda47903 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:16.559282 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-a9838968-8134-46e5-80ee-8a08fda47903 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] [instance: 866ffde4-7bbe-4e59-8cdd-eba253d24fc7] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:16.566773 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a9838968-8134-46e5-80ee-8a08fda47903 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:16.567212 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a9838968-8134-46e5-80ee-8a08fda47903 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:16.568235 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a9838968-8134-46e5-80ee-8a08fda47903 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:16.568488 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a9838968-8134-46e5-80ee-8a08fda47903 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:16.640462 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e8e86c22-4aed-42cd-95e6-d734695fde9d tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:16.641124 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e8e86c22-4aed-42cd-95e6-d734695fde9d tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: bb8ad3f4-a466-4385-9311-93476fe7304e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:16.648453 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e8e86c22-4aed-42cd-95e6-d734695fde9d tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:16.648910 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e8e86c22-4aed-42cd-95e6-d734695fde9d tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:16.649735 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e8e86c22-4aed-42cd-95e6-d734695fde9d tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:16.650215 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e8e86c22-4aed-42cd-95e6-d734695fde9d tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:16.743930 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-a9838968-8134-46e5-80ee-8a08fda47903 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c46c8a697d044c8ba9b2c0e46c70c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd32b6eee5e4a75b6dec0e216953bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:16.751901 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-a9838968-8134-46e5-80ee-8a08fda47903 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] 10.222.0.60 "GET /compute/v2.1/servers/866ffde4-7bbe-4e59-8cdd-eba253d24fc7" status: 200 len: 1264 microversion: 2.1 time: 0.196969 Dec 15 16:24:16.752606 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 221/452] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:16 2021] GET /compute/v2.1/servers/866ffde4-7bbe-4e59-8cdd-eba253d24fc7 => generated 1264 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:16.820584 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e8e86c22-4aed-42cd-95e6-d734695fde9d tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:16.829690 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e8e86c22-4aed-42cd-95e6-d734695fde9d tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e" status: 200 len: 1506 microversion: 2.1 time: 0.192920 Dec 15 16:24:16.830245 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 232/453] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:16 2021] GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e => generated 1506 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:24:17.772287 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-95715e81-78f1-490a-9088-a884607ea0a6 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:17.773033 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-95715e81-78f1-490a-9088-a884607ea0a6 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] [instance: 866ffde4-7bbe-4e59-8cdd-eba253d24fc7] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:17.780516 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-95715e81-78f1-490a-9088-a884607ea0a6 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:17.780965 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-95715e81-78f1-490a-9088-a884607ea0a6 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:17.782038 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-95715e81-78f1-490a-9088-a884607ea0a6 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:17.783551 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-95715e81-78f1-490a-9088-a884607ea0a6 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:17.846670 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d62c48b4-8a66-4bf2-86fa-60a42c136a75 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:17.848066 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d62c48b4-8a66-4bf2-86fa-60a42c136a75 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: bb8ad3f4-a466-4385-9311-93476fe7304e] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:17.855745 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d62c48b4-8a66-4bf2-86fa-60a42c136a75 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:17.856567 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d62c48b4-8a66-4bf2-86fa-60a42c136a75 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:17.857605 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d62c48b4-8a66-4bf2-86fa-60a42c136a75 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:17.858249 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d62c48b4-8a66-4bf2-86fa-60a42c136a75 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:17.981521 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-95715e81-78f1-490a-9088-a884607ea0a6 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c46c8a697d044c8ba9b2c0e46c70c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd32b6eee5e4a75b6dec0e216953bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:17.992113 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-95715e81-78f1-490a-9088-a884607ea0a6 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] 10.222.0.60 "GET /compute/v2.1/servers/866ffde4-7bbe-4e59-8cdd-eba253d24fc7" status: 200 len: 1264 microversion: 2.1 time: 0.223676 Dec 15 16:24:17.994761 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 222/454] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:17 2021] GET /compute/v2.1/servers/866ffde4-7bbe-4e59-8cdd-eba253d24fc7 => generated 1264 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:18.050316 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d62c48b4-8a66-4bf2-86fa-60a42c136a75 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:18.058190 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d62c48b4-8a66-4bf2-86fa-60a42c136a75 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e" status: 200 len: 1506 microversion: 2.1 time: 0.215375 Dec 15 16:24:18.058763 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 233/455] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:17 2021] GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e => generated 1506 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:24:18.401277 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-3725497b-913c-4e11-921d-5566d17f33bc req-1b91101f-b331-4c98-948d-298ed3846eee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb8ad3f4-a466-4385-9311-93476fe7304e", "name": "network-vif-deleted", "tag": "103425f9-977f-478d-a146-0888d66b4144"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:24:18.403948 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:24:18.403948 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Dec 15 16:24:18.412449 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-3725497b-913c-4e11-921d-5566d17f33bc req-1b91101f-b331-4c98-948d-298ed3846eee service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:18.412825 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-3725497b-913c-4e11-921d-5566d17f33bc req-1b91101f-b331-4c98-948d-298ed3846eee service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:18.426631 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-3725497b-913c-4e11-921d-5566d17f33bc req-1b91101f-b331-4c98-948d-298ed3846eee service nova] Creating event network-vif-deleted:103425f9-977f-478d-a146-0888d66b4144 for instance bb8ad3f4-a466-4385-9311-93476fe7304e on hv-cinder-81268 Dec 15 16:24:18.432637 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-3725497b-913c-4e11-921d-5566d17f33bc req-1b91101f-b331-4c98-948d-298ed3846eee service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045845 Dec 15 16:24:18.433576 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 223/456] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:24:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:24:19.021226 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-98bb7dcd-560e-4920-ad60-4e490f34b2d6 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:19.022559 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-98bb7dcd-560e-4920-ad60-4e490f34b2d6 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] [instance: 866ffde4-7bbe-4e59-8cdd-eba253d24fc7] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:19.029215 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-98bb7dcd-560e-4920-ad60-4e490f34b2d6 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:19.029726 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-98bb7dcd-560e-4920-ad60-4e490f34b2d6 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:19.030507 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-98bb7dcd-560e-4920-ad60-4e490f34b2d6 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:19.031173 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-98bb7dcd-560e-4920-ad60-4e490f34b2d6 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:19.076370 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-238dcda7-9085-4d01-930b-d5c1b92b75ad tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:19.077074 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-238dcda7-9085-4d01-930b-d5c1b92b75ad tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: bb8ad3f4-a466-4385-9311-93476fe7304e] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:19.083916 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-238dcda7-9085-4d01-930b-d5c1b92b75ad tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:19.084372 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-238dcda7-9085-4d01-930b-d5c1b92b75ad tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:19.085186 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-238dcda7-9085-4d01-930b-d5c1b92b75ad tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:19.085623 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-238dcda7-9085-4d01-930b-d5c1b92b75ad tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:19.100629 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.wsgi [None req-238dcda7-9085-4d01-930b-d5c1b92b75ad tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] HTTP exception thrown: Instance bb8ad3f4-a466-4385-9311-93476fe7304e could not be found. Dec 15 16:24:19.101326 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-238dcda7-9085-4d01-930b-d5c1b92b75ad tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Returning 404 to user: Instance bb8ad3f4-a466-4385-9311-93476fe7304e could not be found. {{(pid=116085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:24:19.102425 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-238dcda7-9085-4d01-930b-d5c1b92b75ad tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e" status: 404 len: 111 microversion: 2.1 time: 0.030750 Dec 15 16:24:19.107200 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 224/457] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:19 2021] GET /compute/v2.1/servers/bb8ad3f4-a466-4385-9311-93476fe7304e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 16:24:19.112675 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-d81af5bc-2a10-48f9-b692-b8d9e359e6b3 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:19.113216 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-d81af5bc-2a10-48f9-b692-b8d9e359e6b3 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:19.122933 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d81af5bc-2a10-48f9-b692-b8d9e359e6b3 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:19.123397 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d81af5bc-2a10-48f9-b692-b8d9e359e6b3 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:19.124243 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d81af5bc-2a10-48f9-b692-b8d9e359e6b3 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:19.124670 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d81af5bc-2a10-48f9-b692-b8d9e359e6b3 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:19.151723 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-d81af5bc-2a10-48f9-b692-b8d9e359e6b3 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Going to try to terminate instance {{(pid=116085) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:24:19.194326 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-98bb7dcd-560e-4920-ad60-4e490f34b2d6 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c46c8a697d044c8ba9b2c0e46c70c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd32b6eee5e4a75b6dec0e216953bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:19.206472 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-98bb7dcd-560e-4920-ad60-4e490f34b2d6 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] 10.222.0.60 "GET /compute/v2.1/servers/866ffde4-7bbe-4e59-8cdd-eba253d24fc7" status: 200 len: 1264 microversion: 2.1 time: 0.189456 Dec 15 16:24:19.207105 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 234/458] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:19 2021] GET /compute/v2.1/servers/866ffde4-7bbe-4e59-8cdd-eba253d24fc7 => generated 1264 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:19.235611 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-d81af5bc-2a10-48f9-b692-b8d9e359e6b3 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "DELETE /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 204 len: 0 microversion: 2.1 time: 0.126538 Dec 15 16:24:19.236263 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 225/459] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Dec 15 16:24:19 2021] DELETE /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:24:19.244369 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b2a34588-4a52-41c9-82cc-d23098914b8d tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:19.244975 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b2a34588-4a52-41c9-82cc-d23098914b8d tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:19.251323 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b2a34588-4a52-41c9-82cc-d23098914b8d tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:19.251808 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b2a34588-4a52-41c9-82cc-d23098914b8d tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:19.252597 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b2a34588-4a52-41c9-82cc-d23098914b8d tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:19.253028 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b2a34588-4a52-41c9-82cc-d23098914b8d tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:19.407225 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b2a34588-4a52-41c9-82cc-d23098914b8d tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:19.412492 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b2a34588-4a52-41c9-82cc-d23098914b8d tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1520 microversion: 2.1 time: 0.171774 Dec 15 16:24:19.413054 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 235/460] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:19 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:20.225295 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-7c6ad7e4-325f-4140-bcdc-1dda4cbbbf46 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:20.226077 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-7c6ad7e4-325f-4140-bcdc-1dda4cbbbf46 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] [instance: 866ffde4-7bbe-4e59-8cdd-eba253d24fc7] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:20.232877 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7c6ad7e4-325f-4140-bcdc-1dda4cbbbf46 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:20.233325 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7c6ad7e4-325f-4140-bcdc-1dda4cbbbf46 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:20.234120 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7c6ad7e4-325f-4140-bcdc-1dda4cbbbf46 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:20.234550 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7c6ad7e4-325f-4140-bcdc-1dda4cbbbf46 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:20.421795 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-7c6ad7e4-325f-4140-bcdc-1dda4cbbbf46 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c46c8a697d044c8ba9b2c0e46c70c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd32b6eee5e4a75b6dec0e216953bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:20.431062 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-7c6ad7e4-325f-4140-bcdc-1dda4cbbbf46 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] 10.222.0.60 "GET /compute/v2.1/servers/866ffde4-7bbe-4e59-8cdd-eba253d24fc7" status: 200 len: 1264 microversion: 2.1 time: 0.210131 Dec 15 16:24:20.432043 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 226/461] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:20 2021] GET /compute/v2.1/servers/866ffde4-7bbe-4e59-8cdd-eba253d24fc7 => generated 1264 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:20.435416 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b713264a-1609-4c0c-b7bb-8ce064d67ccb tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:20.436487 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b713264a-1609-4c0c-b7bb-8ce064d67ccb tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:20.446288 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b713264a-1609-4c0c-b7bb-8ce064d67ccb tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:20.446746 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b713264a-1609-4c0c-b7bb-8ce064d67ccb tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:20.447604 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b713264a-1609-4c0c-b7bb-8ce064d67ccb tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:20.448038 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b713264a-1609-4c0c-b7bb-8ce064d67ccb tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:20.604440 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b713264a-1609-4c0c-b7bb-8ce064d67ccb tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:20.613072 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b713264a-1609-4c0c-b7bb-8ce064d67ccb tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1520 microversion: 2.1 time: 0.183752 Dec 15 16:24:20.613651 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 236/462] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:20 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:21.450868 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-cf25830f-d7ae-4621-9e78-70862c07712f tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:21.452126 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-cf25830f-d7ae-4621-9e78-70862c07712f tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] [instance: 866ffde4-7bbe-4e59-8cdd-eba253d24fc7] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:21.460696 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-cf25830f-d7ae-4621-9e78-70862c07712f tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:21.461151 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-cf25830f-d7ae-4621-9e78-70862c07712f tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:21.461938 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-cf25830f-d7ae-4621-9e78-70862c07712f tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:21.462378 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-cf25830f-d7ae-4621-9e78-70862c07712f tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:21.614001 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-cf25830f-d7ae-4621-9e78-70862c07712f tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c46c8a697d044c8ba9b2c0e46c70c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd32b6eee5e4a75b6dec0e216953bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:21.622057 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-cf25830f-d7ae-4621-9e78-70862c07712f tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] 10.222.0.60 "GET /compute/v2.1/servers/866ffde4-7bbe-4e59-8cdd-eba253d24fc7" status: 200 len: 1264 microversion: 2.1 time: 0.176356 Dec 15 16:24:21.622654 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 227/463] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:21 2021] GET /compute/v2.1/servers/866ffde4-7bbe-4e59-8cdd-eba253d24fc7 => generated 1264 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:21.634114 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b66c0c25-23a8-462c-b049-1dc7e5b2f214 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:21.635244 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b66c0c25-23a8-462c-b049-1dc7e5b2f214 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:21.646762 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b66c0c25-23a8-462c-b049-1dc7e5b2f214 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:21.647497 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b66c0c25-23a8-462c-b049-1dc7e5b2f214 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:21.648786 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b66c0c25-23a8-462c-b049-1dc7e5b2f214 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:21.649729 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b66c0c25-23a8-462c-b049-1dc7e5b2f214 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:21.784966 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b66c0c25-23a8-462c-b049-1dc7e5b2f214 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:21.793005 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b66c0c25-23a8-462c-b049-1dc7e5b2f214 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1520 microversion: 2.1 time: 0.165974 Dec 15 16:24:21.793573 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 237/464] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:21 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:24:22.640447 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-7fa203e0-c3f6-43bf-bced-2387dce2e1f1 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:22.641033 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-7fa203e0-c3f6-43bf-bced-2387dce2e1f1 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] [instance: 866ffde4-7bbe-4e59-8cdd-eba253d24fc7] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:22.648395 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7fa203e0-c3f6-43bf-bced-2387dce2e1f1 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:22.648826 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7fa203e0-c3f6-43bf-bced-2387dce2e1f1 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:22.649607 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7fa203e0-c3f6-43bf-bced-2387dce2e1f1 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:22.650037 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7fa203e0-c3f6-43bf-bced-2387dce2e1f1 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:22.760317 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ed6d024b-eca0-4447-be07-45ddb5a85638 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:22.760911 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ed6d024b-eca0-4447-be07-45ddb5a85638 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: cb018278-058e-41ee-8bdd-fded5c98ca10] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:22.767800 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ed6d024b-eca0-4447-be07-45ddb5a85638 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:22.768588 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ed6d024b-eca0-4447-be07-45ddb5a85638 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:22.769427 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ed6d024b-eca0-4447-be07-45ddb5a85638 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:22.769815 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ed6d024b-eca0-4447-be07-45ddb5a85638 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:22.799051 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-7fa203e0-c3f6-43bf-bced-2387dce2e1f1 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c46c8a697d044c8ba9b2c0e46c70c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd32b6eee5e4a75b6dec0e216953bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:22.806573 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-7fa203e0-c3f6-43bf-bced-2387dce2e1f1 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] 10.222.0.60 "GET /compute/v2.1/servers/866ffde4-7bbe-4e59-8cdd-eba253d24fc7" status: 200 len: 1264 microversion: 2.1 time: 0.170026 Dec 15 16:24:22.807292 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 228/465] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:22 2021] GET /compute/v2.1/servers/866ffde4-7bbe-4e59-8cdd-eba253d24fc7 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:22.813688 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-2090501e-59f6-4563-91fe-013b35fd085c tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:22.817029 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-2090501e-59f6-4563-91fe-013b35fd085c tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:22.823393 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2090501e-59f6-4563-91fe-013b35fd085c tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:22.823848 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2090501e-59f6-4563-91fe-013b35fd085c tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:22.824845 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2090501e-59f6-4563-91fe-013b35fd085c tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:22.825273 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2090501e-59f6-4563-91fe-013b35fd085c tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:22.874676 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.objects.instance [None req-ed6d024b-eca0-4447-be07-45ddb5a85638 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lazy-loading 'services' on Instance uuid cb018278-058e-41ee-8bdd-fded5c98ca10 {{(pid=116084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:24:22.954021 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ed6d024b-eca0-4447-be07-45ddb5a85638 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "DELETE /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10/os-volume_attachments/763a4360-8297-4fda-8b5d-5a78a0f4832a" status: 202 len: 0 microversion: 2.1 time: 0.197346 Dec 15 16:24:22.955082 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 238/466] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Dec 15 16:24:22 2021] DELETE /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10/os-volume_attachments/763a4360-8297-4fda-8b5d-5a78a0f4832a => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:24:22.963928 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-9f29aa08-3549-41fb-82b1-c0632f501b0f tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:22.964980 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-9f29aa08-3549-41fb-82b1-c0632f501b0f tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: cb018278-058e-41ee-8bdd-fded5c98ca10] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:22.973534 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9f29aa08-3549-41fb-82b1-c0632f501b0f tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:22.973974 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9f29aa08-3549-41fb-82b1-c0632f501b0f tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:22.974494 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-2090501e-59f6-4563-91fe-013b35fd085c tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:22.974746 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9f29aa08-3549-41fb-82b1-c0632f501b0f tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:22.975179 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9f29aa08-3549-41fb-82b1-c0632f501b0f tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:22.989896 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-2090501e-59f6-4563-91fe-013b35fd085c tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1520 microversion: 2.1 time: 0.179847 Dec 15 16:24:22.990831 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 229/467] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:22 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:23.010152 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-9f29aa08-3549-41fb-82b1-c0632f501b0f tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049952 Dec 15 16:24:23.010885 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 239/468] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Dec 15 16:24:22 2021] GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:24:23.832151 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-3711936b-aaa5-4aa7-b114-bce5d85543f6 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:23.833334 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-3711936b-aaa5-4aa7-b114-bce5d85543f6 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] [instance: 866ffde4-7bbe-4e59-8cdd-eba253d24fc7] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:23.854687 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3711936b-aaa5-4aa7-b114-bce5d85543f6 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:23.856610 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3711936b-aaa5-4aa7-b114-bce5d85543f6 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:23.863068 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3711936b-aaa5-4aa7-b114-bce5d85543f6 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:23.865997 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3711936b-aaa5-4aa7-b114-bce5d85543f6 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:24.014498 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-511481a8-294e-4872-9947-e55def29211f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:24.017070 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-511481a8-294e-4872-9947-e55def29211f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:24.024998 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-3711936b-aaa5-4aa7-b114-bce5d85543f6 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c46c8a697d044c8ba9b2c0e46c70c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd32b6eee5e4a75b6dec0e216953bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:24.052937 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-511481a8-294e-4872-9947-e55def29211f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:24.053885 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-511481a8-294e-4872-9947-e55def29211f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:24.057127 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-511481a8-294e-4872-9947-e55def29211f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:24.057127 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-511481a8-294e-4872-9947-e55def29211f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:24.060713 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-3711936b-aaa5-4aa7-b114-bce5d85543f6 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] 10.222.0.60 "GET /compute/v2.1/servers/866ffde4-7bbe-4e59-8cdd-eba253d24fc7" status: 200 len: 1264 microversion: 2.1 time: 0.237485 Dec 15 16:24:24.067536 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 230/469] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:23 2021] GET /compute/v2.1/servers/866ffde4-7bbe-4e59-8cdd-eba253d24fc7 => generated 1264 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:24.077952 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-ba9d4580-9755-440c-848b-e5bf91346d9d tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:24.078882 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-ba9d4580-9755-440c-848b-e5bf91346d9d tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: cb018278-058e-41ee-8bdd-fded5c98ca10] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:24.106265 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ba9d4580-9755-440c-848b-e5bf91346d9d tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:24.110987 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ba9d4580-9755-440c-848b-e5bf91346d9d tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:24.112603 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ba9d4580-9755-440c-848b-e5bf91346d9d tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:24.113274 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ba9d4580-9755-440c-848b-e5bf91346d9d tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:24.152466 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-ba9d4580-9755-440c-848b-e5bf91346d9d tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082706 Dec 15 16:24:24.153431 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 231/470] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Dec 15 16:24:24 2021] GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:24:24.288292 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-511481a8-294e-4872-9947-e55def29211f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:24.297974 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-511481a8-294e-4872-9947-e55def29211f tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1520 microversion: 2.1 time: 0.292130 Dec 15 16:24:24.298569 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 240/471] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:24 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1520 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:25.089650 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-6688ba47-6af8-4d9c-b6fa-9334a1e5ab13 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:25.090263 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-6688ba47-6af8-4d9c-b6fa-9334a1e5ab13 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] [instance: 866ffde4-7bbe-4e59-8cdd-eba253d24fc7] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:25.097212 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6688ba47-6af8-4d9c-b6fa-9334a1e5ab13 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:25.097638 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6688ba47-6af8-4d9c-b6fa-9334a1e5ab13 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:25.098474 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6688ba47-6af8-4d9c-b6fa-9334a1e5ab13 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:25.098894 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6688ba47-6af8-4d9c-b6fa-9334a1e5ab13 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:25.170291 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-203993b7-7e6b-4e1c-97b1-a7833e4416b4 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:25.171906 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-203993b7-7e6b-4e1c-97b1-a7833e4416b4 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: cb018278-058e-41ee-8bdd-fded5c98ca10] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:25.183511 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-203993b7-7e6b-4e1c-97b1-a7833e4416b4 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:25.184224 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-203993b7-7e6b-4e1c-97b1-a7833e4416b4 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:25.185525 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-203993b7-7e6b-4e1c-97b1-a7833e4416b4 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:25.186314 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-203993b7-7e6b-4e1c-97b1-a7833e4416b4 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:25.233215 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-203993b7-7e6b-4e1c-97b1-a7833e4416b4 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069890 Dec 15 16:24:25.233805 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 241/472] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Dec 15 16:24:25 2021] GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:24:25.263622 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-6688ba47-6af8-4d9c-b6fa-9334a1e5ab13 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c46c8a697d044c8ba9b2c0e46c70c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd32b6eee5e4a75b6dec0e216953bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:25.277493 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-6688ba47-6af8-4d9c-b6fa-9334a1e5ab13 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] 10.222.0.60 "GET /compute/v2.1/servers/866ffde4-7bbe-4e59-8cdd-eba253d24fc7" status: 200 len: 1264 microversion: 2.1 time: 0.191678 Dec 15 16:24:25.278512 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 232/473] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:25 2021] GET /compute/v2.1/servers/866ffde4-7bbe-4e59-8cdd-eba253d24fc7 => generated 1264 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:25.315786 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-6119d513-897d-4789-97c1-49dea8582674 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:25.316789 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-6119d513-897d-4789-97c1-49dea8582674 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:25.324708 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6119d513-897d-4789-97c1-49dea8582674 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:25.324961 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6119d513-897d-4789-97c1-49dea8582674 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:25.325766 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6119d513-897d-4789-97c1-49dea8582674 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:25.326992 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6119d513-897d-4789-97c1-49dea8582674 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:25.474889 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-6119d513-897d-4789-97c1-49dea8582674 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:25.483250 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-6119d513-897d-4789-97c1-49dea8582674 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1520 microversion: 2.1 time: 0.171311 Dec 15 16:24:25.483868 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 242/474] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:25 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:26.299641 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-22494b90-217b-431a-96c1-1d4578a94d5d tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:26.300938 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-22494b90-217b-431a-96c1-1d4578a94d5d tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] [instance: 866ffde4-7bbe-4e59-8cdd-eba253d24fc7] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:26.308040 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-22494b90-217b-431a-96c1-1d4578a94d5d tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:26.308467 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-22494b90-217b-431a-96c1-1d4578a94d5d tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:26.309285 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-22494b90-217b-431a-96c1-1d4578a94d5d tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:26.309721 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-22494b90-217b-431a-96c1-1d4578a94d5d tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:26.462018 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e9b3fd63-8751-4dac-900b-58b242bfb32a tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:26.462520 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e9b3fd63-8751-4dac-900b-58b242bfb32a tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: cb018278-058e-41ee-8bdd-fded5c98ca10] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:26.464488 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-22494b90-217b-431a-96c1-1d4578a94d5d tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c46c8a697d044c8ba9b2c0e46c70c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd32b6eee5e4a75b6dec0e216953bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:26.469642 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e9b3fd63-8751-4dac-900b-58b242bfb32a tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:26.470096 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e9b3fd63-8751-4dac-900b-58b242bfb32a tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:26.470900 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e9b3fd63-8751-4dac-900b-58b242bfb32a tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:26.471431 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e9b3fd63-8751-4dac-900b-58b242bfb32a tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:26.475827 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-22494b90-217b-431a-96c1-1d4578a94d5d tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] 10.222.0.60 "GET /compute/v2.1/servers/866ffde4-7bbe-4e59-8cdd-eba253d24fc7" status: 200 len: 1264 microversion: 2.1 time: 0.180649 Dec 15 16:24:26.476424 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 233/475] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:26 2021] GET /compute/v2.1/servers/866ffde4-7bbe-4e59-8cdd-eba253d24fc7 => generated 1264 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:26.499227 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e9b3fd63-8751-4dac-900b-58b242bfb32a tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: cb018278-058e-41ee-8bdd-fded5c98ca10] Going to try to terminate instance {{(pid=116084) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:24:26.501444 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-ebc2a1eb-4261-4783-8fea-3d8a7b8c4892 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:26.502045 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-ebc2a1eb-4261-4783-8fea-3d8a7b8c4892 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:26.508177 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ebc2a1eb-4261-4783-8fea-3d8a7b8c4892 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:26.508622 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ebc2a1eb-4261-4783-8fea-3d8a7b8c4892 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:26.509395 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ebc2a1eb-4261-4783-8fea-3d8a7b8c4892 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:26.509839 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ebc2a1eb-4261-4783-8fea-3d8a7b8c4892 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:26.585936 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e9b3fd63-8751-4dac-900b-58b242bfb32a tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "DELETE /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10" status: 204 len: 0 microversion: 2.1 time: 0.129948 Dec 15 16:24:26.591931 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 243/476] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Dec 15 16:24:26 2021] DELETE /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 15 16:24:26.602126 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-bca37695-5060-47fd-8256-74267bbfaebf tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:26.602831 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-bca37695-5060-47fd-8256-74267bbfaebf tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: cb018278-058e-41ee-8bdd-fded5c98ca10] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:26.613375 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bca37695-5060-47fd-8256-74267bbfaebf tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:26.613823 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bca37695-5060-47fd-8256-74267bbfaebf tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:26.614635 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bca37695-5060-47fd-8256-74267bbfaebf tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:26.615066 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bca37695-5060-47fd-8256-74267bbfaebf tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:26.668766 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-ebc2a1eb-4261-4783-8fea-3d8a7b8c4892 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:26.677011 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-ebc2a1eb-4261-4783-8fea-3d8a7b8c4892 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1520 microversion: 2.1 time: 0.178984 Dec 15 16:24:26.677491 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 234/477] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:26 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:24:26.769550 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-bca37695-5060-47fd-8256-74267bbfaebf tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:26.781549 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-bca37695-5060-47fd-8256-74267bbfaebf tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10" status: 200 len: 1512 microversion: 2.1 time: 0.187343 Dec 15 16:24:26.782295 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 244/478] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:26 2021] GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10 => generated 1512 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:27.494603 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-76c420ff-541b-44d8-bebc-ceb2f38c3ed5 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:27.495243 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-76c420ff-541b-44d8-bebc-ceb2f38c3ed5 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] [instance: 866ffde4-7bbe-4e59-8cdd-eba253d24fc7] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:27.502499 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-76c420ff-541b-44d8-bebc-ceb2f38c3ed5 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:27.503392 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-76c420ff-541b-44d8-bebc-ceb2f38c3ed5 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:27.504409 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-76c420ff-541b-44d8-bebc-ceb2f38c3ed5 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:27.505060 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-76c420ff-541b-44d8-bebc-ceb2f38c3ed5 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:27.669767 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-76c420ff-541b-44d8-bebc-ceb2f38c3ed5 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c46c8a697d044c8ba9b2c0e46c70c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd32b6eee5e4a75b6dec0e216953bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:27.677820 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-76c420ff-541b-44d8-bebc-ceb2f38c3ed5 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] 10.222.0.60 "GET /compute/v2.1/servers/866ffde4-7bbe-4e59-8cdd-eba253d24fc7" status: 200 len: 1264 microversion: 2.1 time: 0.187244 Dec 15 16:24:27.678381 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 235/479] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:27 2021] GET /compute/v2.1/servers/866ffde4-7bbe-4e59-8cdd-eba253d24fc7 => generated 1264 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:27.696140 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-10dc931d-e885-4556-98b7-b2f75aaded5a tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:27.696830 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-10dc931d-e885-4556-98b7-b2f75aaded5a tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:27.711123 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-10dc931d-e885-4556-98b7-b2f75aaded5a tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:27.711756 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-10dc931d-e885-4556-98b7-b2f75aaded5a tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:27.713070 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-10dc931d-e885-4556-98b7-b2f75aaded5a tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:27.713736 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-10dc931d-e885-4556-98b7-b2f75aaded5a tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:27.800809 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-b84180b1-053d-465d-9b9c-3b1c06a74020 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:27.801835 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-b84180b1-053d-465d-9b9c-3b1c06a74020 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: cb018278-058e-41ee-8bdd-fded5c98ca10] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:27.808248 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b84180b1-053d-465d-9b9c-3b1c06a74020 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:27.808692 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b84180b1-053d-465d-9b9c-3b1c06a74020 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:27.809475 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b84180b1-053d-465d-9b9c-3b1c06a74020 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:27.809902 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b84180b1-053d-465d-9b9c-3b1c06a74020 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:27.913961 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-10dc931d-e885-4556-98b7-b2f75aaded5a tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f998e8e291e942f3a088abe00f0b7c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cdbc8211774d9fb8b9dbf7e3f1f080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:27.923013 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-10dc931d-e885-4556-98b7-b2f75aaded5a tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 200 len: 1520 microversion: 2.1 time: 0.230600 Dec 15 16:24:27.923695 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 245/480] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:27 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 1520 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:27.930670 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-2b2cc687-2eb6-44fb-bcf7-6873bec0da98 req-f4b4d951-268b-4fc9-8a19-b211cc57f6dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "129b3afd-1d85-4f6e-94c3-8e7a729ff532", "name": "network-vif-deleted", "tag": "61eaf140-62eb-493c-b139-fe292101564e"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:24:27.932582 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:24:27.932582 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:24:27.944066 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-2b2cc687-2eb6-44fb-bcf7-6873bec0da98 req-f4b4d951-268b-4fc9-8a19-b211cc57f6dd service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:27.944688 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-2b2cc687-2eb6-44fb-bcf7-6873bec0da98 req-f4b4d951-268b-4fc9-8a19-b211cc57f6dd service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:27.956966 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-2b2cc687-2eb6-44fb-bcf7-6873bec0da98 req-f4b4d951-268b-4fc9-8a19-b211cc57f6dd service nova] Creating event network-vif-deleted:61eaf140-62eb-493c-b139-fe292101564e for instance 129b3afd-1d85-4f6e-94c3-8e7a729ff532 on hv-cinder-81268 Dec 15 16:24:27.965840 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-2b2cc687-2eb6-44fb-bcf7-6873bec0da98 req-f4b4d951-268b-4fc9-8a19-b211cc57f6dd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039986 Dec 15 16:24:27.967703 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 246/481] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:24:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:24:28.014769 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-b84180b1-053d-465d-9b9c-3b1c06a74020 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:28.023624 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-b84180b1-053d-465d-9b9c-3b1c06a74020 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10" status: 200 len: 1512 microversion: 2.1 time: 0.226887 Dec 15 16:24:28.024215 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 236/482] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:27 2021] GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10 => generated 1512 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:28.074659 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-c77d0594-1fbf-44e9-b82b-25b79ed2391c req-7e9cf914-67da-41a5-855a-20686dc94aa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "866ffde4-7bbe-4e59-8cdd-eba253d24fc7", "name": "network-vif-plugged", "status": "completed", "tag": "16ce5e62-cdd5-406c-956b-1916ae817f6a"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:24:28.076407 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:24:28.076407 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:24:28.086956 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-c77d0594-1fbf-44e9-b82b-25b79ed2391c req-7e9cf914-67da-41a5-855a-20686dc94aa2 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:28.087546 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-c77d0594-1fbf-44e9-b82b-25b79ed2391c req-7e9cf914-67da-41a5-855a-20686dc94aa2 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:28.099512 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-c77d0594-1fbf-44e9-b82b-25b79ed2391c req-7e9cf914-67da-41a5-855a-20686dc94aa2 service nova] Creating event network-vif-plugged:16ce5e62-cdd5-406c-956b-1916ae817f6a for instance 866ffde4-7bbe-4e59-8cdd-eba253d24fc7 on hv-cinder-81268 Dec 15 16:24:28.104946 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-c77d0594-1fbf-44e9-b82b-25b79ed2391c req-7e9cf914-67da-41a5-855a-20686dc94aa2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034928 Dec 15 16:24:28.105913 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 247/483] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:24:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:24:28.698653 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-000e5f86-8e8b-4aec-8c04-6b209139859f tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:28.699207 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-000e5f86-8e8b-4aec-8c04-6b209139859f tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] [instance: 866ffde4-7bbe-4e59-8cdd-eba253d24fc7] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:28.708685 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-000e5f86-8e8b-4aec-8c04-6b209139859f tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:28.709133 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-000e5f86-8e8b-4aec-8c04-6b209139859f tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:28.709955 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-000e5f86-8e8b-4aec-8c04-6b209139859f tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:28.710385 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-000e5f86-8e8b-4aec-8c04-6b209139859f tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:28.902856 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-000e5f86-8e8b-4aec-8c04-6b209139859f tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c46c8a697d044c8ba9b2c0e46c70c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd32b6eee5e4a75b6dec0e216953bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:28.912075 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-000e5f86-8e8b-4aec-8c04-6b209139859f tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] 10.222.0.60 "GET /compute/v2.1/servers/866ffde4-7bbe-4e59-8cdd-eba253d24fc7" status: 200 len: 1264 microversion: 2.1 time: 0.219580 Dec 15 16:24:28.912650 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 237/484] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:28 2021] GET /compute/v2.1/servers/866ffde4-7bbe-4e59-8cdd-eba253d24fc7 => generated 1264 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:28.944103 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-dadf3684-d64b-48e0-bdd1-232f7b9d8d35 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:28.944954 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-dadf3684-d64b-48e0-bdd1-232f7b9d8d35 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] [instance: 129b3afd-1d85-4f6e-94c3-8e7a729ff532] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:28.951560 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dadf3684-d64b-48e0-bdd1-232f7b9d8d35 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:28.951928 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dadf3684-d64b-48e0-bdd1-232f7b9d8d35 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:28.952730 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dadf3684-d64b-48e0-bdd1-232f7b9d8d35 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:28.953161 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dadf3684-d64b-48e0-bdd1-232f7b9d8d35 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:28.968401 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-dadf3684-d64b-48e0-bdd1-232f7b9d8d35 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] HTTP exception thrown: Instance 129b3afd-1d85-4f6e-94c3-8e7a729ff532 could not be found. Dec 15 16:24:28.968984 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-dadf3684-d64b-48e0-bdd1-232f7b9d8d35 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] Returning 404 to user: Instance 129b3afd-1d85-4f6e-94c3-8e7a729ff532 could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:24:28.969840 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-dadf3684-d64b-48e0-bdd1-232f7b9d8d35 tempest-ServerRescueNegativeTestJSON-1844007362 tempest-ServerRescueNegativeTestJSON-1844007362-project] 10.222.0.60 "GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532" status: 404 len: 111 microversion: 2.1 time: 0.031798 Dec 15 16:24:28.970410 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 248/485] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:28 2021] GET /compute/v2.1/servers/129b3afd-1d85-4f6e-94c3-8e7a729ff532 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 16:24:29.041072 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-8e00d835-2631-468a-ba0e-75f7b273fed5 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:29.041793 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-8e00d835-2631-468a-ba0e-75f7b273fed5 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: cb018278-058e-41ee-8bdd-fded5c98ca10] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:29.048791 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8e00d835-2631-468a-ba0e-75f7b273fed5 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:29.049625 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8e00d835-2631-468a-ba0e-75f7b273fed5 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:29.050495 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8e00d835-2631-468a-ba0e-75f7b273fed5 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:29.051262 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8e00d835-2631-468a-ba0e-75f7b273fed5 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:29.200522 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-8e00d835-2631-468a-ba0e-75f7b273fed5 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:29.208494 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-8e00d835-2631-468a-ba0e-75f7b273fed5 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10" status: 200 len: 1512 microversion: 2.1 time: 0.171500 Dec 15 16:24:29.209081 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 238/486] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:29 2021] GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10 => generated 1512 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:29.935010 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ac8d99ef-6575-43e1-b4c6-fe6d16ab22fd tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:29.936323 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ac8d99ef-6575-43e1-b4c6-fe6d16ab22fd tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] [instance: 866ffde4-7bbe-4e59-8cdd-eba253d24fc7] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:29.947831 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ac8d99ef-6575-43e1-b4c6-fe6d16ab22fd tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:29.951228 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ac8d99ef-6575-43e1-b4c6-fe6d16ab22fd tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:29.955423 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ac8d99ef-6575-43e1-b4c6-fe6d16ab22fd tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:29.956173 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ac8d99ef-6575-43e1-b4c6-fe6d16ab22fd tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:29.985813 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-0015b0ee-dbfd-47ff-b11b-70cbf0804a11 req-767827ae-fadd-42ac-bc58-6edd6f4cd4ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb018278-058e-41ee-8bdd-fded5c98ca10", "name": "network-vif-deleted", "tag": "b966396f-ab45-4ab1-a379-55a0bbe41429"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:24:29.988366 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:24:29.988366 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Dec 15 16:24:30.010580 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-0015b0ee-dbfd-47ff-b11b-70cbf0804a11 req-767827ae-fadd-42ac-bc58-6edd6f4cd4ae service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:30.011166 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-0015b0ee-dbfd-47ff-b11b-70cbf0804a11 req-767827ae-fadd-42ac-bc58-6edd6f4cd4ae service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:30.056824 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-0015b0ee-dbfd-47ff-b11b-70cbf0804a11 req-767827ae-fadd-42ac-bc58-6edd6f4cd4ae service nova] Creating event network-vif-deleted:b966396f-ab45-4ab1-a379-55a0bbe41429 for instance cb018278-058e-41ee-8bdd-fded5c98ca10 on hv-cinder-81268 Dec 15 16:24:30.067910 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-0015b0ee-dbfd-47ff-b11b-70cbf0804a11 req-767827ae-fadd-42ac-bc58-6edd6f4cd4ae service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087820 Dec 15 16:24:30.068664 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 239/487] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:24:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:24:30.177163 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ac8d99ef-6575-43e1-b4c6-fe6d16ab22fd tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c46c8a697d044c8ba9b2c0e46c70c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd32b6eee5e4a75b6dec0e216953bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:30.185141 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ac8d99ef-6575-43e1-b4c6-fe6d16ab22fd tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] 10.222.0.60 "GET /compute/v2.1/servers/866ffde4-7bbe-4e59-8cdd-eba253d24fc7" status: 200 len: 1451 microversion: 2.1 time: 0.254130 Dec 15 16:24:30.186343 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 249/488] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:29 2021] GET /compute/v2.1/servers/866ffde4-7bbe-4e59-8cdd-eba253d24fc7 => generated 1451 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:30.207200 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-ce3a1fe3-ef1f-4156-99f0-49e1a48e0c07 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:30.208441 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-ce3a1fe3-ef1f-4156-99f0-49e1a48e0c07 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] [instance: 866ffde4-7bbe-4e59-8cdd-eba253d24fc7] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:30.219137 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ce3a1fe3-ef1f-4156-99f0-49e1a48e0c07 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:30.219661 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ce3a1fe3-ef1f-4156-99f0-49e1a48e0c07 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:30.221308 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ce3a1fe3-ef1f-4156-99f0-49e1a48e0c07 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:30.221939 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ce3a1fe3-ef1f-4156-99f0-49e1a48e0c07 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:30.228300 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-20659aba-d48e-4d1c-84e8-3936004e1d3e tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:30.230364 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-20659aba-d48e-4d1c-84e8-3936004e1d3e tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: cb018278-058e-41ee-8bdd-fded5c98ca10] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:30.239322 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-20659aba-d48e-4d1c-84e8-3936004e1d3e tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:30.239921 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-20659aba-d48e-4d1c-84e8-3936004e1d3e tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:30.240803 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-20659aba-d48e-4d1c-84e8-3936004e1d3e tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:30.241439 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-20659aba-d48e-4d1c-84e8-3936004e1d3e tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:30.279441 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-20659aba-d48e-4d1c-84e8-3936004e1d3e tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:30.280307 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-20659aba-d48e-4d1c-84e8-3936004e1d3e tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:30.280978 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.objects.instance [None req-20659aba-d48e-4d1c-84e8-3936004e1d3e tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lazy-loading 'fault' on Instance uuid cb018278-058e-41ee-8bdd-fded5c98ca10 {{(pid=116084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:24:30.344341 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-20659aba-d48e-4d1c-84e8-3936004e1d3e tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:30.353388 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-20659aba-d48e-4d1c-84e8-3936004e1d3e tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10" status: 200 len: 1307 microversion: 2.1 time: 0.131500 Dec 15 16:24:30.354704 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 250/489] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:30 2021] GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10 => generated 1307 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:30.425908 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-ce3a1fe3-ef1f-4156-99f0-49e1a48e0c07 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c46c8a697d044c8ba9b2c0e46c70c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd32b6eee5e4a75b6dec0e216953bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:30.433466 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-ce3a1fe3-ef1f-4156-99f0-49e1a48e0c07 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] 10.222.0.60 "GET /compute/v2.1/servers/866ffde4-7bbe-4e59-8cdd-eba253d24fc7" status: 200 len: 1451 microversion: 2.1 time: 0.232934 Dec 15 16:24:30.434052 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 240/490] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:30 2021] GET /compute/v2.1/servers/866ffde4-7bbe-4e59-8cdd-eba253d24fc7 => generated 1451 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:31.373770 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-6969bec9-0147-4669-9daa-67c5b58074a5 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:31.374651 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-6969bec9-0147-4669-9daa-67c5b58074a5 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: cb018278-058e-41ee-8bdd-fded5c98ca10] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:31.383226 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6969bec9-0147-4669-9daa-67c5b58074a5 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:31.383733 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6969bec9-0147-4669-9daa-67c5b58074a5 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:31.384517 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6969bec9-0147-4669-9daa-67c5b58074a5 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:31.385113 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6969bec9-0147-4669-9daa-67c5b58074a5 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:31.401650 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-6969bec9-0147-4669-9daa-67c5b58074a5 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] HTTP exception thrown: Instance cb018278-058e-41ee-8bdd-fded5c98ca10 could not be found. Dec 15 16:24:31.402239 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-6969bec9-0147-4669-9daa-67c5b58074a5 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Returning 404 to user: Instance cb018278-058e-41ee-8bdd-fded5c98ca10 could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:24:31.403080 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-6969bec9-0147-4669-9daa-67c5b58074a5 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10" status: 404 len: 111 microversion: 2.1 time: 0.034522 Dec 15 16:24:31.403949 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 251/491] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:31 2021] GET /compute/v2.1/servers/cb018278-058e-41ee-8bdd-fded5c98ca10 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:24:32.584772 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-96a65ad3-64a4-43e2-85f0-234d6f60fcfc tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:32.586000 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-96a65ad3-64a4-43e2-85f0-234d6f60fcfc tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: fefd60c0-a2af-4432-9260-c3046035cb4f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:32.598644 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-96a65ad3-64a4-43e2-85f0-234d6f60fcfc tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:32.599531 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-96a65ad3-64a4-43e2-85f0-234d6f60fcfc tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:32.600693 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-96a65ad3-64a4-43e2-85f0-234d6f60fcfc tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:32.601197 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-96a65ad3-64a4-43e2-85f0-234d6f60fcfc tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:32.639103 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-96a65ad3-64a4-43e2-85f0-234d6f60fcfc tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: fefd60c0-a2af-4432-9260-c3046035cb4f] Going to try to terminate instance {{(pid=116085) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:24:32.756960 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-96a65ad3-64a4-43e2-85f0-234d6f60fcfc tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "DELETE /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f" status: 204 len: 0 microversion: 2.1 time: 0.177906 Dec 15 16:24:32.757789 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 241/492] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Dec 15 16:24:32 2021] DELETE /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:24:32.769251 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e03502fa-5127-474e-9581-7e95a83887b4 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:32.770102 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e03502fa-5127-474e-9581-7e95a83887b4 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: fefd60c0-a2af-4432-9260-c3046035cb4f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:32.777541 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e03502fa-5127-474e-9581-7e95a83887b4 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:32.778146 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e03502fa-5127-474e-9581-7e95a83887b4 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:32.778974 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e03502fa-5127-474e-9581-7e95a83887b4 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:32.779671 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e03502fa-5127-474e-9581-7e95a83887b4 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:33.455206 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e03502fa-5127-474e-9581-7e95a83887b4 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:33.467781 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e03502fa-5127-474e-9581-7e95a83887b4 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f" status: 200 len: 1513 microversion: 2.1 time: 0.704804 Dec 15 16:24:33.468464 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 252/493] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:32 2021] GET /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f => generated 1513 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:33.789616 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-5d45391e-121b-4550-b9fe-3523cb4d6337 req-1cfe19c0-e8ba-4df3-89ae-20ee9e863da0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "866ffde4-7bbe-4e59-8cdd-eba253d24fc7", "tag": "16ce5e62-cdd5-406c-956b-1916ae817f6a"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:24:33.793919 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:24:33.793919 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Dec 15 16:24:33.803404 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-5d45391e-121b-4550-b9fe-3523cb4d6337 req-1cfe19c0-e8ba-4df3-89ae-20ee9e863da0 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:33.804008 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-5d45391e-121b-4550-b9fe-3523cb4d6337 req-1cfe19c0-e8ba-4df3-89ae-20ee9e863da0 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:33.818161 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-5d45391e-121b-4550-b9fe-3523cb4d6337 req-1cfe19c0-e8ba-4df3-89ae-20ee9e863da0 service nova] Creating event network-changed:16ce5e62-cdd5-406c-956b-1916ae817f6a for instance 866ffde4-7bbe-4e59-8cdd-eba253d24fc7 on hv-cinder-81268 Dec 15 16:24:33.824477 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-5d45391e-121b-4550-b9fe-3523cb4d6337 req-1cfe19c0-e8ba-4df3-89ae-20ee9e863da0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040241 Dec 15 16:24:33.826106 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 242/494] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:24:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:24:34.488095 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e85613cd-3426-4536-b0f1-e3cb725649f4 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:34.488706 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e85613cd-3426-4536-b0f1-e3cb725649f4 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: fefd60c0-a2af-4432-9260-c3046035cb4f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:34.496864 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e85613cd-3426-4536-b0f1-e3cb725649f4 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:34.497320 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e85613cd-3426-4536-b0f1-e3cb725649f4 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:34.498295 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e85613cd-3426-4536-b0f1-e3cb725649f4 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:34.498896 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e85613cd-3426-4536-b0f1-e3cb725649f4 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:34.701826 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e85613cd-3426-4536-b0f1-e3cb725649f4 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:34.715338 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e85613cd-3426-4536-b0f1-e3cb725649f4 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f" status: 200 len: 1513 microversion: 2.1 time: 0.230520 Dec 15 16:24:34.716590 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 253/495] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:34 2021] GET /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f => generated 1513 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:35.256231 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-4282b866-463d-4157-9340-f73b5f9c65fd req-3da5ac0f-3b28-4a84-9849-c87a2f2e0e19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fefd60c0-a2af-4432-9260-c3046035cb4f", "name": "network-vif-deleted", "tag": "e5590de1-ee90-4501-b614-78b851657c16"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:24:35.258891 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:24:35.258891 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Dec 15 16:24:35.274922 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-4282b866-463d-4157-9340-f73b5f9c65fd req-3da5ac0f-3b28-4a84-9849-c87a2f2e0e19 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:35.276470 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-4282b866-463d-4157-9340-f73b5f9c65fd req-3da5ac0f-3b28-4a84-9849-c87a2f2e0e19 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:35.299278 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-4282b866-463d-4157-9340-f73b5f9c65fd req-3da5ac0f-3b28-4a84-9849-c87a2f2e0e19 service nova] Creating event network-vif-deleted:e5590de1-ee90-4501-b614-78b851657c16 for instance fefd60c0-a2af-4432-9260-c3046035cb4f on hv-cinder-81268 Dec 15 16:24:35.332022 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-4282b866-463d-4157-9340-f73b5f9c65fd req-3da5ac0f-3b28-4a84-9849-c87a2f2e0e19 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081095 Dec 15 16:24:35.333252 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 243/496] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:24:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:24:35.733448 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-eb8f408c-d0d1-40cc-b3f8-9f997d4483c5 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:35.734061 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-eb8f408c-d0d1-40cc-b3f8-9f997d4483c5 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: fefd60c0-a2af-4432-9260-c3046035cb4f] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:35.741455 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-eb8f408c-d0d1-40cc-b3f8-9f997d4483c5 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:35.741927 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-eb8f408c-d0d1-40cc-b3f8-9f997d4483c5 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:35.742743 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-eb8f408c-d0d1-40cc-b3f8-9f997d4483c5 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:35.743173 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-eb8f408c-d0d1-40cc-b3f8-9f997d4483c5 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:35.747493 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:24:35.747493 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: Wed Dec 15 16:24:35 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:24:35.794365 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-eb8f408c-d0d1-40cc-b3f8-9f997d4483c5 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:35.794939 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-eb8f408c-d0d1-40cc-b3f8-9f997d4483c5 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:35.795514 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.objects.instance [None req-eb8f408c-d0d1-40cc-b3f8-9f997d4483c5 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lazy-loading 'fault' on Instance uuid fefd60c0-a2af-4432-9260-c3046035cb4f {{(pid=116084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:24:35.847362 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-eb8f408c-d0d1-40cc-b3f8-9f997d4483c5 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:35.855064 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-eb8f408c-d0d1-40cc-b3f8-9f997d4483c5 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f" status: 200 len: 1308 microversion: 2.1 time: 0.125620 Dec 15 16:24:35.855677 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 254/497] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:35 2021] GET /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f => generated 1308 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:36.873796 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-d53e8b89-9f70-4e5c-9028-16f316254196 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:36.875243 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-d53e8b89-9f70-4e5c-9028-16f316254196 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: fefd60c0-a2af-4432-9260-c3046035cb4f] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:36.886220 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d53e8b89-9f70-4e5c-9028-16f316254196 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:36.887021 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d53e8b89-9f70-4e5c-9028-16f316254196 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:36.888327 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d53e8b89-9f70-4e5c-9028-16f316254196 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:36.888925 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d53e8b89-9f70-4e5c-9028-16f316254196 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:36.903991 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.wsgi [None req-d53e8b89-9f70-4e5c-9028-16f316254196 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] HTTP exception thrown: Instance fefd60c0-a2af-4432-9260-c3046035cb4f could not be found. Dec 15 16:24:36.904566 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-d53e8b89-9f70-4e5c-9028-16f316254196 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Returning 404 to user: Instance fefd60c0-a2af-4432-9260-c3046035cb4f could not be found. {{(pid=116085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:24:36.905684 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-d53e8b89-9f70-4e5c-9028-16f316254196 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f" status: 404 len: 111 microversion: 2.1 time: 0.036139 Dec 15 16:24:36.910915 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 244/498] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:36 2021] GET /compute/v2.1/servers/fefd60c0-a2af-4432-9260-c3046035cb4f => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:24:36.915985 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-50826199-a152-48d6-b29f-9b93b2ed5baa tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:36.917187 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-50826199-a152-48d6-b29f-9b93b2ed5baa tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: e2e4e9fd-273e-4f05-811f-d997caf4636c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:36.925811 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-50826199-a152-48d6-b29f-9b93b2ed5baa tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:36.926413 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-50826199-a152-48d6-b29f-9b93b2ed5baa tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:36.927284 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-50826199-a152-48d6-b29f-9b93b2ed5baa tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:36.927991 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-50826199-a152-48d6-b29f-9b93b2ed5baa tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:36.958942 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-50826199-a152-48d6-b29f-9b93b2ed5baa tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: e2e4e9fd-273e-4f05-811f-d997caf4636c] Going to try to terminate instance {{(pid=116084) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:24:37.063332 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-50826199-a152-48d6-b29f-9b93b2ed5baa tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e2e4e9fd-273e-4f05-811f-d997caf4636c" status: 204 len: 0 microversion: 2.1 time: 0.150971 Dec 15 16:24:37.064468 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 255/499] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Dec 15 16:24:36 2021] DELETE /compute/v2.1/servers/e2e4e9fd-273e-4f05-811f-d997caf4636c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 15 16:24:37.076980 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-54f2b7ed-6a6e-425d-931b-006e46d0a732 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:37.078093 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-54f2b7ed-6a6e-425d-931b-006e46d0a732 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: e2e4e9fd-273e-4f05-811f-d997caf4636c] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:37.087902 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-54f2b7ed-6a6e-425d-931b-006e46d0a732 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:37.088726 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-54f2b7ed-6a6e-425d-931b-006e46d0a732 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:37.090144 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-54f2b7ed-6a6e-425d-931b-006e46d0a732 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:37.090931 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-54f2b7ed-6a6e-425d-931b-006e46d0a732 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:37.281196 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-54f2b7ed-6a6e-425d-931b-006e46d0a732 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:37.290409 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-54f2b7ed-6a6e-425d-931b-006e46d0a732 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/e2e4e9fd-273e-4f05-811f-d997caf4636c" status: 200 len: 1513 microversion: 2.1 time: 0.219661 Dec 15 16:24:37.301344 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 245/500] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:37 2021] GET /compute/v2.1/servers/e2e4e9fd-273e-4f05-811f-d997caf4636c => generated 1513 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:38.309054 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-7aba44c5-6c80-4c53-8d50-04a3815f5539 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:38.309941 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-7aba44c5-6c80-4c53-8d50-04a3815f5539 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: e2e4e9fd-273e-4f05-811f-d997caf4636c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:38.321987 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7aba44c5-6c80-4c53-8d50-04a3815f5539 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:38.323237 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7aba44c5-6c80-4c53-8d50-04a3815f5539 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:38.324445 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7aba44c5-6c80-4c53-8d50-04a3815f5539 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:38.325591 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7aba44c5-6c80-4c53-8d50-04a3815f5539 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:38.506269 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-7aba44c5-6c80-4c53-8d50-04a3815f5539 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:38.514418 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-7aba44c5-6c80-4c53-8d50-04a3815f5539 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/e2e4e9fd-273e-4f05-811f-d997caf4636c" status: 200 len: 1513 microversion: 2.1 time: 0.209419 Dec 15 16:24:38.514998 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 256/501] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:38 2021] GET /compute/v2.1/servers/e2e4e9fd-273e-4f05-811f-d997caf4636c => generated 1513 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:39.531812 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-abd1d611-c70c-4325-8b07-e11b6e5beea5 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:39.532412 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-abd1d611-c70c-4325-8b07-e11b6e5beea5 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: e2e4e9fd-273e-4f05-811f-d997caf4636c] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:39.539530 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-abd1d611-c70c-4325-8b07-e11b6e5beea5 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:39.539974 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-abd1d611-c70c-4325-8b07-e11b6e5beea5 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:39.540758 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-abd1d611-c70c-4325-8b07-e11b6e5beea5 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:39.541182 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-abd1d611-c70c-4325-8b07-e11b6e5beea5 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:39.713214 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-abd1d611-c70c-4325-8b07-e11b6e5beea5 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:39.729378 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-abd1d611-c70c-4325-8b07-e11b6e5beea5 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/e2e4e9fd-273e-4f05-811f-d997caf4636c" status: 200 len: 1513 microversion: 2.1 time: 0.200808 Dec 15 16:24:39.742007 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 246/502] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:39 2021] GET /compute/v2.1/servers/e2e4e9fd-273e-4f05-811f-d997caf4636c => generated 1513 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:40.663658 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ab1d103f-c036-49a6-912a-3d54baedc707 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'create', calling method: .version_select at 0x7f0b26bd6ee0>, body: {"keypair": {"name": "tempest-keypair-888932254"}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:24:40.679410 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-ab1d103f-c036-49a6-912a-3d54baedc707 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Getting quotas for project 9dc6fd27025742699d14dbf14680c7c3. Resources: {'key_pairs'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:24:40.683954 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-ab1d103f-c036-49a6-912a-3d54baedc707 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Getting quotas for user 4a7cfeb030104d338be8575f10d8ec68 and project 9dc6fd27025742699d14dbf14680c7c3. Resources: {'key_pairs'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:24:40.749669 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-670b2c6a-f385-4e12-a686-a39f7684fd7b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:40.750215 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-670b2c6a-f385-4e12-a686-a39f7684fd7b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: e2e4e9fd-273e-4f05-811f-d997caf4636c] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:40.757226 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-670b2c6a-f385-4e12-a686-a39f7684fd7b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:40.757954 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-670b2c6a-f385-4e12-a686-a39f7684fd7b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:40.758941 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-670b2c6a-f385-4e12-a686-a39f7684fd7b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:40.759565 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-670b2c6a-f385-4e12-a686-a39f7684fd7b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:40.913112 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-ab1d103f-c036-49a6-912a-3d54baedc707 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Getting quotas for project 9dc6fd27025742699d14dbf14680c7c3. Resources: {'key_pairs'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:24:40.918018 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-ab1d103f-c036-49a6-912a-3d54baedc707 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Getting quotas for user 4a7cfeb030104d338be8575f10d8ec68 and project 9dc6fd27025742699d14dbf14680c7c3. Resources: {'key_pairs'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:24:40.935767 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ab1d103f-c036-49a6-912a-3d54baedc707 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.481931 Dec 15 16:24:40.936803 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 257/503] 10.222.0.60 () {62 vars in 1198 bytes} [Wed Dec 15 16:24:40 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 484 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 15 16:24:40.940889 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-670b2c6a-f385-4e12-a686-a39f7684fd7b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:40.950178 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-670b2c6a-f385-4e12-a686-a39f7684fd7b tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/e2e4e9fd-273e-4f05-811f-d997caf4636c" status: 200 len: 1513 microversion: 2.1 time: 0.204275 Dec 15 16:24:40.961100 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 247/504] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:40 2021] GET /compute/v2.1/servers/e2e4e9fd-273e-4f05-811f-d997caf4636c => generated 1513 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:41.158042 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-be30ebc2-a7a9-4603-ae12-d5598915d842 req-cdae4c69-351d-4460-ab57-e1f5d0d138fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2e4e9fd-273e-4f05-811f-d997caf4636c", "name": "network-vif-deleted", "tag": "1351aeaa-4e2c-4d63-aadd-c4160a439008"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:24:41.160057 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:24:41.160057 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:24:41.182082 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-be30ebc2-a7a9-4603-ae12-d5598915d842 req-cdae4c69-351d-4460-ab57-e1f5d0d138fa service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:41.192199 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-be30ebc2-a7a9-4603-ae12-d5598915d842 req-cdae4c69-351d-4460-ab57-e1f5d0d138fa service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:41.233464 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-be30ebc2-a7a9-4603-ae12-d5598915d842 req-cdae4c69-351d-4460-ab57-e1f5d0d138fa service nova] Creating event network-vif-deleted:1351aeaa-4e2c-4d63-aadd-c4160a439008 for instance e2e4e9fd-273e-4f05-811f-d997caf4636c on hv-cinder-81268 Dec 15 16:24:41.259056 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-be30ebc2-a7a9-4603-ae12-d5598915d842 req-cdae4c69-351d-4460-ab57-e1f5d0d138fa service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105028 Dec 15 16:24:41.259838 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 258/505] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:24:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:24:41.967763 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-7689859c-a6d5-42b2-9d01-de2ccf326e25 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:41.968570 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-7689859c-a6d5-42b2-9d01-de2ccf326e25 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: e2e4e9fd-273e-4f05-811f-d997caf4636c] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:41.975180 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7689859c-a6d5-42b2-9d01-de2ccf326e25 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:41.975710 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7689859c-a6d5-42b2-9d01-de2ccf326e25 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:41.976498 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7689859c-a6d5-42b2-9d01-de2ccf326e25 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:41.976918 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7689859c-a6d5-42b2-9d01-de2ccf326e25 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:41.992055 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.wsgi [None req-7689859c-a6d5-42b2-9d01-de2ccf326e25 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] HTTP exception thrown: Instance e2e4e9fd-273e-4f05-811f-d997caf4636c could not be found. Dec 15 16:24:41.992743 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-7689859c-a6d5-42b2-9d01-de2ccf326e25 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Returning 404 to user: Instance e2e4e9fd-273e-4f05-811f-d997caf4636c could not be found. {{(pid=116085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:24:41.993636 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-7689859c-a6d5-42b2-9d01-de2ccf326e25 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/e2e4e9fd-273e-4f05-811f-d997caf4636c" status: 404 len: 111 microversion: 2.1 time: 0.029683 Dec 15 16:24:41.997506 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 248/506] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:41 2021] GET /compute/v2.1/servers/e2e4e9fd-273e-4f05-811f-d997caf4636c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:24:42.608910 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ce9ba4c6-720f-4e31-b89d-9db4ff2ddb0e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-362923789", "imageRef": "b72b5f54-34d0-48ac-9484-bc8104a6dddb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "89d58e9b-0fd5-43aa-b277-d040a9af8bd8"}], "security_groups": [{"name": "tempest-securitygroup--709944934"}], "key_name": "tempest-keypair-888932254", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:24:42.742204 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.network.neutron [None req-ce9ba4c6-720f-4e31-b89d-9db4ff2ddb0e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] validate_networks() for [('89d58e9b-0fd5-43aa-b277-d040a9af8bd8', None, None, None, None, None)] {{(pid=116084) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:24:43.175878 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-f43704e3-6bd5-41e6-b180-ec1759d74d2e tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:43.177041 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-f43704e3-6bd5-41e6-b180-ec1759d74d2e tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: 365b5223-e068-4113-abe1-797e13f5e901] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:43.184089 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f43704e3-6bd5-41e6-b180-ec1759d74d2e tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:43.184535 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f43704e3-6bd5-41e6-b180-ec1759d74d2e tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:43.185329 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f43704e3-6bd5-41e6-b180-ec1759d74d2e tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:43.185755 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f43704e3-6bd5-41e6-b180-ec1759d74d2e tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:43.216258 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-ce9ba4c6-720f-4e31-b89d-9db4ff2ddb0e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Flavor limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:24:43.216911 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-ce9ba4c6-720f-4e31-b89d-9db4ff2ddb0e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Image limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:24:43.217671 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-ce9ba4c6-720f-4e31-b89d-9db4ff2ddb0e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Flavor pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:24:43.218324 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-ce9ba4c6-720f-4e31-b89d-9db4ff2ddb0e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Image pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:24:43.218981 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-ce9ba4c6-720f-4e31-b89d-9db4ff2ddb0e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:24:43.224265 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-f43704e3-6bd5-41e6-b180-ec1759d74d2e tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: 365b5223-e068-4113-abe1-797e13f5e901] Going to try to terminate instance {{(pid=116085) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:24:43.239079 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ce9ba4c6-720f-4e31-b89d-9db4ff2ddb0e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:43.240215 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ce9ba4c6-720f-4e31-b89d-9db4ff2ddb0e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:43.241847 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ce9ba4c6-720f-4e31-b89d-9db4ff2ddb0e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:43.242796 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ce9ba4c6-720f-4e31-b89d-9db4ff2ddb0e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:43.275245 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-ce9ba4c6-720f-4e31-b89d-9db4ff2ddb0e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Getting quotas for project 9dc6fd27025742699d14dbf14680c7c3. Resources: {'cores', 'instances', 'ram'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:24:43.280677 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-ce9ba4c6-720f-4e31-b89d-9db4ff2ddb0e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Getting quotas for user 4a7cfeb030104d338be8575f10d8ec68 and project 9dc6fd27025742699d14dbf14680c7c3. Resources: {'cores', 'instances', 'ram'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:24:43.296354 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ce9ba4c6-720f-4e31-b89d-9db4ff2ddb0e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Going to run 1 instances... {{(pid=116084) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:24:43.299049 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ce9ba4c6-720f-4e31-b89d-9db4ff2ddb0e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b72b5f54-34d0-48ac-9484-bc8104a6dddb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116084) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:24:43.348921 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-f43704e3-6bd5-41e6-b180-ec1759d74d2e tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "DELETE /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901" status: 204 len: 0 microversion: 2.1 time: 0.177284 Dec 15 16:24:43.354893 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 249/507] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Dec 15 16:24:43 2021] DELETE /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:24:43.362375 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-3cfe8d0b-631f-4ce1-9df2-e8181ce22a35 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:43.364440 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-3cfe8d0b-631f-4ce1-9df2-e8181ce22a35 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: 365b5223-e068-4113-abe1-797e13f5e901] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:43.370704 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3cfe8d0b-631f-4ce1-9df2-e8181ce22a35 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:43.371256 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3cfe8d0b-631f-4ce1-9df2-e8181ce22a35 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:43.372352 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3cfe8d0b-631f-4ce1-9df2-e8181ce22a35 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:43.372672 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3cfe8d0b-631f-4ce1-9df2-e8181ce22a35 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:43.374158 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ce9ba4c6-720f-4e31-b89d-9db4ff2ddb0e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.770584 Dec 15 16:24:43.380548 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 259/508] 10.222.0.60 () {62 vars in 1187 bytes} [Wed Dec 15 16:24:42 2021] POST /compute/v2.1/servers => generated 401 bytes in 778 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 15 16:24:43.386079 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-19527df2-431f-4dcf-b21d-ee140226ee71 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:43.386681 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-19527df2-431f-4dcf-b21d-ee140226ee71 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:43.487987 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-19527df2-431f-4dcf-b21d-ee140226ee71 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:43.498912 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-19527df2-431f-4dcf-b21d-ee140226ee71 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:43.500459 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-19527df2-431f-4dcf-b21d-ee140226ee71 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:43.501600 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-19527df2-431f-4dcf-b21d-ee140226ee71 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1280 microversion: 2.20 time: 0.119378 Dec 15 16:24:43.502526 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 260/509] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:24:43 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1280 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:24:43.570278 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-3cfe8d0b-631f-4ce1-9df2-e8181ce22a35 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:43.577913 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-3cfe8d0b-631f-4ce1-9df2-e8181ce22a35 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901" status: 200 len: 1513 microversion: 2.1 time: 0.221189 Dec 15 16:24:43.578559 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 250/510] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:43 2021] GET /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901 => generated 1513 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:44.521553 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-a5a49214-143a-4cb2-8fba-c016cf21cc86 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:44.522214 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-a5a49214-143a-4cb2-8fba-c016cf21cc86 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:44.529418 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a5a49214-143a-4cb2-8fba-c016cf21cc86 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:44.529921 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a5a49214-143a-4cb2-8fba-c016cf21cc86 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:44.530937 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a5a49214-143a-4cb2-8fba-c016cf21cc86 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:44.531572 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a5a49214-143a-4cb2-8fba-c016cf21cc86 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:44.598161 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-0328df96-1036-4b31-83c3-8eae14e2c976 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:44.598865 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-0328df96-1036-4b31-83c3-8eae14e2c976 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: 365b5223-e068-4113-abe1-797e13f5e901] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:44.599563 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-a5a49214-143a-4cb2-8fba-c016cf21cc86 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:44.608506 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-a5a49214-143a-4cb2-8fba-c016cf21cc86 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:44.610288 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0328df96-1036-4b31-83c3-8eae14e2c976 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:44.610731 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-a5a49214-143a-4cb2-8fba-c016cf21cc86 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:44.612078 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-a5a49214-143a-4cb2-8fba-c016cf21cc86 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1332 microversion: 2.20 time: 0.094692 Dec 15 16:24:44.612544 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0328df96-1036-4b31-83c3-8eae14e2c976 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:44.613043 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 261/511] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:24:44 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1332 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:24:44.613523 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0328df96-1036-4b31-83c3-8eae14e2c976 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:44.625438 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0328df96-1036-4b31-83c3-8eae14e2c976 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:44.818225 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-0328df96-1036-4b31-83c3-8eae14e2c976 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:44.827459 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-0328df96-1036-4b31-83c3-8eae14e2c976 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901" status: 200 len: 1513 microversion: 2.1 time: 0.233665 Dec 15 16:24:44.828204 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 251/512] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:44 2021] GET /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901 => generated 1513 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:45.632412 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-21cfca67-c959-4dd5-83b3-6868c1e4ab6e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:45.633056 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-21cfca67-c959-4dd5-83b3-6868c1e4ab6e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:45.639935 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-21cfca67-c959-4dd5-83b3-6868c1e4ab6e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:45.640443 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-21cfca67-c959-4dd5-83b3-6868c1e4ab6e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:45.641259 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-21cfca67-c959-4dd5-83b3-6868c1e4ab6e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:45.641697 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-21cfca67-c959-4dd5-83b3-6868c1e4ab6e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:45.703879 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-21cfca67-c959-4dd5-83b3-6868c1e4ab6e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:45.712632 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-21cfca67-c959-4dd5-83b3-6868c1e4ab6e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:45.714114 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-21cfca67-c959-4dd5-83b3-6868c1e4ab6e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:45.715197 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-21cfca67-c959-4dd5-83b3-6868c1e4ab6e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1338 microversion: 2.20 time: 0.087398 Dec 15 16:24:45.716272 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 262/513] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:24:45 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1338 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:24:45.846645 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-71913557-f37d-404a-af0a-d60cc8cb379a tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:45.847785 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-71913557-f37d-404a-af0a-d60cc8cb379a tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: 365b5223-e068-4113-abe1-797e13f5e901] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:45.854648 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-71913557-f37d-404a-af0a-d60cc8cb379a tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:45.855196 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-71913557-f37d-404a-af0a-d60cc8cb379a tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:45.856081 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-71913557-f37d-404a-af0a-d60cc8cb379a tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:45.856595 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-71913557-f37d-404a-af0a-d60cc8cb379a tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:46.041264 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-71913557-f37d-404a-af0a-d60cc8cb379a tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c81feca86e49f193efb42a81a6c3c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cccb6b08dc94f04a5efa2624d350007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:46.057896 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-71913557-f37d-404a-af0a-d60cc8cb379a tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901" status: 200 len: 1513 microversion: 2.1 time: 0.214993 Dec 15 16:24:46.058488 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 252/514] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:45 2021] GET /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901 => generated 1513 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:24:46.281940 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-4c37d98a-cf7e-43b1-bd33-0d482e5ed716 req-6aa76016-23ae-4d8b-b99c-bf48744f39f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "365b5223-e068-4113-abe1-797e13f5e901", "name": "network-vif-deleted", "tag": "2a99c3c6-1c76-4557-ba21-b6d579694eac"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:24:46.284803 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:24:46.284803 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:24:46.292271 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-4c37d98a-cf7e-43b1-bd33-0d482e5ed716 req-6aa76016-23ae-4d8b-b99c-bf48744f39f3 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:46.292989 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-4c37d98a-cf7e-43b1-bd33-0d482e5ed716 req-6aa76016-23ae-4d8b-b99c-bf48744f39f3 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:46.305678 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-4c37d98a-cf7e-43b1-bd33-0d482e5ed716 req-6aa76016-23ae-4d8b-b99c-bf48744f39f3 service nova] Creating event network-vif-deleted:2a99c3c6-1c76-4557-ba21-b6d579694eac for instance 365b5223-e068-4113-abe1-797e13f5e901 on hv-cinder-81268 Dec 15 16:24:46.311309 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-4c37d98a-cf7e-43b1-bd33-0d482e5ed716 req-6aa76016-23ae-4d8b-b99c-bf48744f39f3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038764 Dec 15 16:24:46.312629 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 263/515] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:24:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:24:46.734693 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-735b78f1-e6a3-4c15-ad8d-2f3eadb79557 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:46.735728 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-735b78f1-e6a3-4c15-ad8d-2f3eadb79557 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:46.742594 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-735b78f1-e6a3-4c15-ad8d-2f3eadb79557 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:46.743259 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-735b78f1-e6a3-4c15-ad8d-2f3eadb79557 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:46.744300 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-735b78f1-e6a3-4c15-ad8d-2f3eadb79557 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:46.744899 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-735b78f1-e6a3-4c15-ad8d-2f3eadb79557 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:46.911974 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-735b78f1-e6a3-4c15-ad8d-2f3eadb79557 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:46.920071 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-735b78f1-e6a3-4c15-ad8d-2f3eadb79557 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:46.921589 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-735b78f1-e6a3-4c15-ad8d-2f3eadb79557 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:46.922715 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-735b78f1-e6a3-4c15-ad8d-2f3eadb79557 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1405 microversion: 2.20 time: 0.192130 Dec 15 16:24:46.923280 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 253/516] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:24:46 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1405 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:24:47.082079 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-3399ddfa-1682-423c-ab2a-e3a096f405b6 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:47.082655 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-3399ddfa-1682-423c-ab2a-e3a096f405b6 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] [instance: 365b5223-e068-4113-abe1-797e13f5e901] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:47.090353 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3399ddfa-1682-423c-ab2a-e3a096f405b6 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:47.091141 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3399ddfa-1682-423c-ab2a-e3a096f405b6 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:47.092563 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3399ddfa-1682-423c-ab2a-e3a096f405b6 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:47.093279 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3399ddfa-1682-423c-ab2a-e3a096f405b6 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:47.115700 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-3399ddfa-1682-423c-ab2a-e3a096f405b6 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] HTTP exception thrown: Instance 365b5223-e068-4113-abe1-797e13f5e901 could not be found. Dec 15 16:24:47.116594 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-3399ddfa-1682-423c-ab2a-e3a096f405b6 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] Returning 404 to user: Instance 365b5223-e068-4113-abe1-797e13f5e901 could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:24:47.117418 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-3399ddfa-1682-423c-ab2a-e3a096f405b6 tempest-AttachVolumeNegativeTest-7627578 tempest-AttachVolumeNegativeTest-7627578-project] 10.222.0.60 "GET /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901" status: 404 len: 111 microversion: 2.1 time: 0.047083 Dec 15 16:24:47.121204 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 264/517] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:47 2021] GET /compute/v2.1/servers/365b5223-e068-4113-abe1-797e13f5e901 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:24:47.942079 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-5ea5b44f-1c2a-4d23-84c4-5f9f9d8551f6 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:47.942858 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-5ea5b44f-1c2a-4d23-84c4-5f9f9d8551f6 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:47.949596 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5ea5b44f-1c2a-4d23-84c4-5f9f9d8551f6 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:47.950272 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5ea5b44f-1c2a-4d23-84c4-5f9f9d8551f6 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:47.951233 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5ea5b44f-1c2a-4d23-84c4-5f9f9d8551f6 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:47.951697 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5ea5b44f-1c2a-4d23-84c4-5f9f9d8551f6 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:48.176739 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-5ea5b44f-1c2a-4d23-84c4-5f9f9d8551f6 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:48.185260 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-5ea5b44f-1c2a-4d23-84c4-5f9f9d8551f6 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:48.187315 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-5ea5b44f-1c2a-4d23-84c4-5f9f9d8551f6 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:48.188517 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-5ea5b44f-1c2a-4d23-84c4-5f9f9d8551f6 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1405 microversion: 2.20 time: 0.250575 Dec 15 16:24:48.189083 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 254/518] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:24:47 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1405 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:24:48.340256 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-310edd6e-049f-4c88-8179-3646288f03aa req-fadb8d71-e44b-4e3b-b5a6-726e6c331cd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "049761b5-88eb-4325-af0e-03da2842cbf5", "tag": "71e495aa-7e03-4d0e-9f9d-b7560a684e27"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:24:48.342229 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:24:48.342229 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:24:48.351093 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-310edd6e-049f-4c88-8179-3646288f03aa req-fadb8d71-e44b-4e3b-b5a6-726e6c331cd6 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:48.351676 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-310edd6e-049f-4c88-8179-3646288f03aa req-fadb8d71-e44b-4e3b-b5a6-726e6c331cd6 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:48.364324 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-310edd6e-049f-4c88-8179-3646288f03aa req-fadb8d71-e44b-4e3b-b5a6-726e6c331cd6 service nova] Creating event network-changed:71e495aa-7e03-4d0e-9f9d-b7560a684e27 for instance 049761b5-88eb-4325-af0e-03da2842cbf5 on hv-cinder-81268 Dec 15 16:24:48.369675 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-310edd6e-049f-4c88-8179-3646288f03aa req-fadb8d71-e44b-4e3b-b5a6-726e6c331cd6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033402 Dec 15 16:24:48.370605 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 265/519] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:24:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:24:48.982326 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-a9d242e2-b703-475c-aa13-cd733d1d3e1b tempest-VolumesSnapshotsTestJSON-1080365279 tempest-VolumesSnapshotsTestJSON-1080365279-project] Action: 'create', calling method: .version_select at 0x7f0b26bde310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1161755194"}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:24:49.206492 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-610db840-05b6-41b5-b7d9-6aae78de2230 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:49.207177 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-610db840-05b6-41b5-b7d9-6aae78de2230 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:49.214160 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-610db840-05b6-41b5-b7d9-6aae78de2230 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:49.214575 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-610db840-05b6-41b5-b7d9-6aae78de2230 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:49.215363 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-610db840-05b6-41b5-b7d9-6aae78de2230 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:49.215965 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-610db840-05b6-41b5-b7d9-6aae78de2230 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:49.295121 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-a9d242e2-b703-475c-aa13-cd733d1d3e1b tempest-VolumesSnapshotsTestJSON-1080365279 tempest-VolumesSnapshotsTestJSON-1080365279-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.469492 Dec 15 16:24:49.296387 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 255/520] 10.222.0.60 () {60 vars in 1154 bytes} [Wed Dec 15 16:24:48 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 472 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Dec 15 16:24:49.307192 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-87cf53ab-bad7-4b69-948d-467417a10a81 tempest-VolumesSnapshotsTestJSON-1080365279 tempest-VolumesSnapshotsTestJSON-1080365279-project] Calling method '.version_select at 0x7f0b26a31820>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:49.373078 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-87cf53ab-bad7-4b69-948d-467417a10a81 tempest-VolumesSnapshotsTestJSON-1080365279 tempest-VolumesSnapshotsTestJSON-1080365279-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/00f8bca7-8c91-4ee5-8eb3-669c99554613" status: 200 len: 345 microversion: 2.1 time: 0.069010 Dec 15 16:24:49.374093 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 256/521] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Dec 15 16:24:49 2021] GET /compute/v2.1/os-volumes/00f8bca7-8c91-4ee5-8eb3-669c99554613 => generated 345 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:24:49.411525 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-610db840-05b6-41b5-b7d9-6aae78de2230 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:49.419868 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-610db840-05b6-41b5-b7d9-6aae78de2230 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:49.421352 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-610db840-05b6-41b5-b7d9-6aae78de2230 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:49.422442 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-610db840-05b6-41b5-b7d9-6aae78de2230 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1405 microversion: 2.20 time: 0.220110 Dec 15 16:24:49.422994 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 266/522] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:24:49 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1405 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:24:50.390330 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-7db84407-3b41-44ee-a49b-f8e4299d3007 tempest-VolumesSnapshotsTestJSON-1080365279 tempest-VolumesSnapshotsTestJSON-1080365279-project] Calling method '.version_select at 0x7f0b26a313a0>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:50.442632 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-82b486f7-8187-4453-877d-ec07bbf41c82 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:50.443569 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-82b486f7-8187-4453-877d-ec07bbf41c82 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:50.450657 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-82b486f7-8187-4453-877d-ec07bbf41c82 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:50.451502 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-82b486f7-8187-4453-877d-ec07bbf41c82 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:50.452562 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-82b486f7-8187-4453-877d-ec07bbf41c82 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:50.453114 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-82b486f7-8187-4453-877d-ec07bbf41c82 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:50.462775 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-7db84407-3b41-44ee-a49b-f8e4299d3007 tempest-VolumesSnapshotsTestJSON-1080365279 tempest-VolumesSnapshotsTestJSON-1080365279-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/00f8bca7-8c91-4ee5-8eb3-669c99554613" status: 200 len: 346 microversion: 2.1 time: 0.080184 Dec 15 16:24:50.464401 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 257/523] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Dec 15 16:24:50 2021] GET /compute/v2.1/os-volumes/00f8bca7-8c91-4ee5-8eb3-669c99554613 => generated 346 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:24:50.469421 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-025478dd-d177-4ac4-8134-6cfb5fdbcce7 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1151729011", "imageRef": "b72b5f54-34d0-48ac-9484-bc8104a6dddb", "flavorRef": "452", "networks": [{"uuid": "57950f25-a0f8-46d5-8479-44bfafba8631"}]}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:24:50.539861 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.network.neutron [None req-025478dd-d177-4ac4-8134-6cfb5fdbcce7 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] validate_networks() for [('57950f25-a0f8-46d5-8479-44bfafba8631', None, None, None, None, None)] {{(pid=116085) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:24:50.718643 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-82b486f7-8187-4453-877d-ec07bbf41c82 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:50.732097 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-82b486f7-8187-4453-877d-ec07bbf41c82 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:50.735324 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-82b486f7-8187-4453-877d-ec07bbf41c82 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:50.737725 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-82b486f7-8187-4453-877d-ec07bbf41c82 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1405 microversion: 2.20 time: 0.299462 Dec 15 16:24:50.738662 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 267/524] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:24:50 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1405 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:24:50.744169 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-2d1e03bc-4f7a-4abd-8ab8-a253eb02c877 tempest-VolumesSnapshotsTestJSON-1080365279 tempest-VolumesSnapshotsTestJSON-1080365279-project] Action: 'create', calling method: .version_select at 0x7f0b26b23ca0>, body: {"snapshot": {"volume_id": "00f8bca7-8c91-4ee5-8eb3-669c99554613", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-882156575"}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:24:50.937391 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-2d1e03bc-4f7a-4abd-8ab8-a253eb02c877 tempest-VolumesSnapshotsTestJSON-1080365279 tempest-VolumesSnapshotsTestJSON-1080365279-project] 10.222.0.60 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.197240 Dec 15 16:24:50.942886 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 268/525] 10.222.0.60 () {60 vars in 1161 bytes} [Wed Dec 15 16:24:50 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:24:50.948095 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-fb5df985-ea8b-4e22-b96e-dddb83071556 tempest-VolumesSnapshotsTestJSON-1080365279 tempest-VolumesSnapshotsTestJSON-1080365279-project] Calling method '.version_select at 0x7f0b26a7de50>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:50.993891 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-fb5df985-ea8b-4e22-b96e-dddb83071556 tempest-VolumesSnapshotsTestJSON-1080365279 tempest-VolumesSnapshotsTestJSON-1080365279-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/cd9c0d3e-3a87-4703-ab88-4794019e637b" status: 200 len: 286 microversion: 2.1 time: 0.049470 Dec 15 16:24:50.999454 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 269/526] 10.222.0.60 () {58 vars in 1250 bytes} [Wed Dec 15 16:24:50 2021] GET /compute/v2.1/os-snapshots/cd9c0d3e-3a87-4703-ab88-4794019e637b => generated 286 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:24:51.008506 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-aad11a0b-85a7-4588-a883-cb987af4371e tempest-VolumesSnapshotsTestJSON-1080365279 tempest-VolumesSnapshotsTestJSON-1080365279-project] Calling method '.version_select at 0x7f0b26a88af0>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:51.010947 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-025478dd-d177-4ac4-8134-6cfb5fdbcce7 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Flavor limits 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:24:51.011697 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-025478dd-d177-4ac4-8134-6cfb5fdbcce7 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Image limits 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:24:51.012304 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-025478dd-d177-4ac4-8134-6cfb5fdbcce7 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Flavor pref 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:24:51.012824 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-025478dd-d177-4ac4-8134-6cfb5fdbcce7 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Image pref 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:24:51.013246 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-025478dd-d177-4ac4-8134-6cfb5fdbcce7 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:24:51.023394 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-025478dd-d177-4ac4-8134-6cfb5fdbcce7 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:51.023899 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-025478dd-d177-4ac4-8134-6cfb5fdbcce7 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:51.024733 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-025478dd-d177-4ac4-8134-6cfb5fdbcce7 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:51.025164 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-025478dd-d177-4ac4-8134-6cfb5fdbcce7 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:51.046447 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-025478dd-d177-4ac4-8134-6cfb5fdbcce7 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Getting quotas for project 3f435a136a5e44f89a0b09d4ec7427b7. Resources: {'cores', 'instances', 'ram'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:24:51.051071 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-025478dd-d177-4ac4-8134-6cfb5fdbcce7 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Getting quotas for user 39b8a0a1adc54ff4abafe90692d10543 and project 3f435a136a5e44f89a0b09d4ec7427b7. Resources: {'cores', 'instances', 'ram'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:24:51.051301 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-aad11a0b-85a7-4588-a883-cb987af4371e tempest-VolumesSnapshotsTestJSON-1080365279 tempest-VolumesSnapshotsTestJSON-1080365279-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.048503 Dec 15 16:24:51.052538 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 270/527] 10.222.0.60 () {58 vars in 1139 bytes} [Wed Dec 15 16:24:51 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:24:51.067771 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-6397ebf4-34c6-4ecb-b8e3-7883cb3d76ee tempest-VolumesSnapshotsTestJSON-1080365279 tempest-VolumesSnapshotsTestJSON-1080365279-project] Calling method '.version_select at 0x7f0b27474040>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:51.072150 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-025478dd-d177-4ac4-8134-6cfb5fdbcce7 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Going to run 1 instances... {{(pid=116085) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:24:51.076645 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-025478dd-d177-4ac4-8134-6cfb5fdbcce7 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] [instance: 4b73cd2e-45d9-4808-a4d4-db5836234372] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b72b5f54-34d0-48ac-9484-bc8104a6dddb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116085) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:24:51.105746 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-6397ebf4-34c6-4ecb-b8e3-7883cb3d76ee tempest-VolumesSnapshotsTestJSON-1080365279 tempest-VolumesSnapshotsTestJSON-1080365279-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/cd9c0d3e-3a87-4703-ab88-4794019e637b" status: 200 len: 286 microversion: 2.1 time: 0.043831 Dec 15 16:24:51.106796 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 271/528] 10.222.0.60 () {58 vars in 1250 bytes} [Wed Dec 15 16:24:51 2021] GET /compute/v2.1/os-snapshots/cd9c0d3e-3a87-4703-ab88-4794019e637b => generated 286 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:24:51.129445 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-025478dd-d177-4ac4-8134-6cfb5fdbcce7 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.663655 Dec 15 16:24:51.130081 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 258/529] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Dec 15 16:24:50 2021] POST /compute/v2.1/servers => generated 380 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 16:24:51.141862 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-522c1938-51b2-4d7d-8467-be65abd9a0b2 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:51.142690 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-522c1938-51b2-4d7d-8467-be65abd9a0b2 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] [instance: 4b73cd2e-45d9-4808-a4d4-db5836234372] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:51.204913 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-522c1938-51b2-4d7d-8467-be65abd9a0b2 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b8a0a1adc54ff4abafe90692d10543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f435a136a5e44f89a0b09d4ec7427b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:51.212472 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-522c1938-51b2-4d7d-8467-be65abd9a0b2 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] 10.222.0.60 "GET /compute/v2.1/servers/4b73cd2e-45d9-4808-a4d4-db5836234372" status: 200 len: 1219 microversion: 2.1 time: 0.074231 Dec 15 16:24:51.213085 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 272/530] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:51 2021] GET /compute/v2.1/servers/4b73cd2e-45d9-4808-a4d4-db5836234372 => generated 1219 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:51.763737 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-ae75b051-0125-4f96-a02f-29f4d156a889 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:51.764336 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-ae75b051-0125-4f96-a02f-29f4d156a889 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:51.771253 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ae75b051-0125-4f96-a02f-29f4d156a889 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:51.771757 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ae75b051-0125-4f96-a02f-29f4d156a889 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:51.772582 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ae75b051-0125-4f96-a02f-29f4d156a889 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:51.773017 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ae75b051-0125-4f96-a02f-29f4d156a889 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:51.923359 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-ae75b051-0125-4f96-a02f-29f4d156a889 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:51.933419 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-ae75b051-0125-4f96-a02f-29f4d156a889 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:51.934943 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-ae75b051-0125-4f96-a02f-29f4d156a889 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:51.936136 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-ae75b051-0125-4f96-a02f-29f4d156a889 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1405 microversion: 2.20 time: 0.176720 Dec 15 16:24:51.936739 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 259/531] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:24:51 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1405 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:24:52.118781 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c55449b4-bc54-4228-b7ad-270e66f6a70b tempest-VolumesSnapshotsTestJSON-1080365279 tempest-VolumesSnapshotsTestJSON-1080365279-project] Calling method '.version_select at 0x7f0b26baadc0>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:52.150974 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c55449b4-bc54-4228-b7ad-270e66f6a70b tempest-VolumesSnapshotsTestJSON-1080365279 tempest-VolumesSnapshotsTestJSON-1080365279-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/cd9c0d3e-3a87-4703-ab88-4794019e637b" status: 200 len: 286 microversion: 2.1 time: 0.036237 Dec 15 16:24:52.151614 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 273/532] 10.222.0.60 () {58 vars in 1250 bytes} [Wed Dec 15 16:24:52 2021] GET /compute/v2.1/os-snapshots/cd9c0d3e-3a87-4703-ab88-4794019e637b => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:24:52.236271 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-c506ab4c-0d1f-4730-af76-dcb63d83e3fc tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:52.237014 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-c506ab4c-0d1f-4730-af76-dcb63d83e3fc tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] [instance: 4b73cd2e-45d9-4808-a4d4-db5836234372] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:52.244574 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c506ab4c-0d1f-4730-af76-dcb63d83e3fc tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:52.245052 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c506ab4c-0d1f-4730-af76-dcb63d83e3fc tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:52.245916 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c506ab4c-0d1f-4730-af76-dcb63d83e3fc tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:52.246350 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c506ab4c-0d1f-4730-af76-dcb63d83e3fc tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:52.308406 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-c506ab4c-0d1f-4730-af76-dcb63d83e3fc tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b8a0a1adc54ff4abafe90692d10543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f435a136a5e44f89a0b09d4ec7427b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:52.323201 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-c506ab4c-0d1f-4730-af76-dcb63d83e3fc tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] 10.222.0.60 "GET /compute/v2.1/servers/4b73cd2e-45d9-4808-a4d4-db5836234372" status: 200 len: 1223 microversion: 2.1 time: 0.090548 Dec 15 16:24:52.323760 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 260/533] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:52 2021] GET /compute/v2.1/servers/4b73cd2e-45d9-4808-a4d4-db5836234372 => generated 1223 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:52.955822 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-96ed400f-5dc5-4466-be76-18648d256f96 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:52.956918 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-96ed400f-5dc5-4466-be76-18648d256f96 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:52.964398 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-96ed400f-5dc5-4466-be76-18648d256f96 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:52.964849 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-96ed400f-5dc5-4466-be76-18648d256f96 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:52.965940 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-96ed400f-5dc5-4466-be76-18648d256f96 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:52.966374 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-96ed400f-5dc5-4466-be76-18648d256f96 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:53.131849 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-96ed400f-5dc5-4466-be76-18648d256f96 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:53.140972 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-96ed400f-5dc5-4466-be76-18648d256f96 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:53.142561 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-96ed400f-5dc5-4466-be76-18648d256f96 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:53.143869 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-96ed400f-5dc5-4466-be76-18648d256f96 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1405 microversion: 2.20 time: 0.192798 Dec 15 16:24:53.144536 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 274/534] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:24:52 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1405 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:24:53.165239 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-4fff64b4-8892-43c2-8a7d-503557c483f9 tempest-VolumesSnapshotsTestJSON-1080365279 tempest-VolumesSnapshotsTestJSON-1080365279-project] Calling method '.version_select at 0x7f0b26a31c10>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:53.203909 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-4fff64b4-8892-43c2-8a7d-503557c483f9 tempest-VolumesSnapshotsTestJSON-1080365279 tempest-VolumesSnapshotsTestJSON-1080365279-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/cd9c0d3e-3a87-4703-ab88-4794019e637b" status: 200 len: 286 microversion: 2.1 time: 0.041895 Dec 15 16:24:53.204879 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 261/535] 10.222.0.60 () {58 vars in 1250 bytes} [Wed Dec 15 16:24:53 2021] GET /compute/v2.1/os-snapshots/cd9c0d3e-3a87-4703-ab88-4794019e637b => generated 286 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:24:53.340668 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-8284405c-a69a-4758-a972-3515618dc5b6 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:53.341308 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-8284405c-a69a-4758-a972-3515618dc5b6 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] [instance: 4b73cd2e-45d9-4808-a4d4-db5836234372] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:53.348310 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8284405c-a69a-4758-a972-3515618dc5b6 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:53.348758 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8284405c-a69a-4758-a972-3515618dc5b6 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:53.349558 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8284405c-a69a-4758-a972-3515618dc5b6 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:53.349991 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8284405c-a69a-4758-a972-3515618dc5b6 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:53.411401 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-8284405c-a69a-4758-a972-3515618dc5b6 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b8a0a1adc54ff4abafe90692d10543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f435a136a5e44f89a0b09d4ec7427b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:53.419000 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-8284405c-a69a-4758-a972-3515618dc5b6 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] 10.222.0.60 "GET /compute/v2.1/servers/4b73cd2e-45d9-4808-a4d4-db5836234372" status: 200 len: 1215 microversion: 2.1 time: 0.082175 Dec 15 16:24:53.419605 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 275/536] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:53 2021] GET /compute/v2.1/servers/4b73cd2e-45d9-4808-a4d4-db5836234372 => generated 1215 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:54.026654 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-6d9c7726-26fb-41c3-826a-f2c3f35cfce8 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:54.029086 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-6d9c7726-26fb-41c3-826a-f2c3f35cfce8 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:54.040438 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6d9c7726-26fb-41c3-826a-f2c3f35cfce8 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:54.041341 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6d9c7726-26fb-41c3-826a-f2c3f35cfce8 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:54.042856 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6d9c7726-26fb-41c3-826a-f2c3f35cfce8 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:54.043722 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6d9c7726-26fb-41c3-826a-f2c3f35cfce8 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:54.083762 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-78333eff-f9bb-467a-81d4-e18d132524eb req-e3ffa4b2-ef51-4f05-91f1-63c81c93ad74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "049761b5-88eb-4325-af0e-03da2842cbf5", "name": "network-vif-plugged", "status": "completed", "tag": "71e495aa-7e03-4d0e-9f9d-b7560a684e27"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:24:54.086136 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:24:54.086136 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:24:54.094047 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-78333eff-f9bb-467a-81d4-e18d132524eb req-e3ffa4b2-ef51-4f05-91f1-63c81c93ad74 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:54.094478 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-78333eff-f9bb-467a-81d4-e18d132524eb req-e3ffa4b2-ef51-4f05-91f1-63c81c93ad74 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:54.117011 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-78333eff-f9bb-467a-81d4-e18d132524eb req-e3ffa4b2-ef51-4f05-91f1-63c81c93ad74 service nova] Creating event network-vif-plugged:71e495aa-7e03-4d0e-9f9d-b7560a684e27 for instance 049761b5-88eb-4325-af0e-03da2842cbf5 on hv-cinder-81268 Dec 15 16:24:54.125780 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-78333eff-f9bb-467a-81d4-e18d132524eb req-e3ffa4b2-ef51-4f05-91f1-63c81c93ad74 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046518 Dec 15 16:24:54.126986 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 276/537] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:24:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:24:54.164855 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.objects.instance [None req-6d9c7726-26fb-41c3-826a-f2c3f35cfce8 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lazy-loading 'services' on Instance uuid f48359cf-b1e0-4786-885d-3aa339bbf38a {{(pid=116085) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:24:54.165089 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-235fdc01-8c9a-4867-ac10-2302891cc447 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:54.166434 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-235fdc01-8c9a-4867-ac10-2302891cc447 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:54.174233 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-235fdc01-8c9a-4867-ac10-2302891cc447 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:54.175354 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-235fdc01-8c9a-4867-ac10-2302891cc447 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:54.176792 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-235fdc01-8c9a-4867-ac10-2302891cc447 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:54.177383 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-235fdc01-8c9a-4867-ac10-2302891cc447 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:54.304403 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-6d9c7726-26fb-41c3-826a-f2c3f35cfce8 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/os-volume_attachments/0a6deef8-82f0-4338-b702-d09befa93e45" status: 202 len: 0 microversion: 2.1 time: 0.284424 Dec 15 16:24:54.305433 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 262/538] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Dec 15 16:24:54 2021] DELETE /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/os-volume_attachments/0a6deef8-82f0-4338-b702-d09befa93e45 => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:24:54.333962 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-f36198bf-1a52-40ef-b9ba-5ab7a3c30b97 tempest-VolumesSnapshotsTestJSON-1080365279 tempest-VolumesSnapshotsTestJSON-1080365279-project] Calling method '.version_select at 0x7f0b26a31280>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:54.406126 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-f36198bf-1a52-40ef-b9ba-5ab7a3c30b97 tempest-VolumesSnapshotsTestJSON-1080365279 tempest-VolumesSnapshotsTestJSON-1080365279-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/cd9c0d3e-3a87-4703-ab88-4794019e637b" status: 200 len: 287 microversion: 2.1 time: 0.098724 Dec 15 16:24:54.407582 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 263/539] 10.222.0.60 () {58 vars in 1250 bytes} [Wed Dec 15 16:24:54 2021] GET /compute/v2.1/os-snapshots/cd9c0d3e-3a87-4703-ab88-4794019e637b => generated 287 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:24:54.420963 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-1296ed78-6272-459f-9bdc-2c149c50997c tempest-VolumesSnapshotsTestJSON-1080365279 tempest-VolumesSnapshotsTestJSON-1080365279-project] Calling method '.version_select at 0x7f0b26a31ee0>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:54.428222 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-235fdc01-8c9a-4867-ac10-2302891cc447 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:54.441057 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-235fdc01-8c9a-4867-ac10-2302891cc447 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:54.442721 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-235fdc01-8c9a-4867-ac10-2302891cc447 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:54.444241 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-235fdc01-8c9a-4867-ac10-2302891cc447 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1405 microversion: 2.20 time: 0.283843 Dec 15 16:24:54.462276 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 277/540] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:24:54 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1405 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:24:54.471250 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f79b0252-4fe9-4608-9b0c-c9f88f900462 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:54.474496 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f79b0252-4fe9-4608-9b0c-c9f88f900462 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] [instance: 4b73cd2e-45d9-4808-a4d4-db5836234372] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:54.494047 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f79b0252-4fe9-4608-9b0c-c9f88f900462 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:54.494503 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f79b0252-4fe9-4608-9b0c-c9f88f900462 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:54.495316 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f79b0252-4fe9-4608-9b0c-c9f88f900462 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:54.495993 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f79b0252-4fe9-4608-9b0c-c9f88f900462 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:54.559256 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-1296ed78-6272-459f-9bdc-2c149c50997c tempest-VolumesSnapshotsTestJSON-1080365279 tempest-VolumesSnapshotsTestJSON-1080365279-project] 10.222.0.60 "DELETE /compute/v2.1/os-snapshots/cd9c0d3e-3a87-4703-ab88-4794019e637b" status: 202 len: 0 microversion: 2.1 time: 0.144413 Dec 15 16:24:54.560430 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 264/541] 10.222.0.60 () {58 vars in 1253 bytes} [Wed Dec 15 16:24:54 2021] DELETE /compute/v2.1/os-snapshots/cd9c0d3e-3a87-4703-ab88-4794019e637b => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:24:54.572398 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-bf057a09-0b0a-40c7-9a4d-f603124029dd tempest-VolumesSnapshotsTestJSON-1080365279 tempest-VolumesSnapshotsTestJSON-1080365279-project] Calling method '.version_select at 0x7f0b26a8f1f0>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:54.582791 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f79b0252-4fe9-4608-9b0c-c9f88f900462 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b8a0a1adc54ff4abafe90692d10543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f435a136a5e44f89a0b09d4ec7427b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:54.601647 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f79b0252-4fe9-4608-9b0c-c9f88f900462 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] 10.222.0.60 "GET /compute/v2.1/servers/4b73cd2e-45d9-4808-a4d4-db5836234372" status: 200 len: 1279 microversion: 2.1 time: 0.137863 Dec 15 16:24:54.604964 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 278/542] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:54 2021] GET /compute/v2.1/servers/4b73cd2e-45d9-4808-a4d4-db5836234372 => generated 1279 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:54.624447 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-bf057a09-0b0a-40c7-9a4d-f603124029dd tempest-VolumesSnapshotsTestJSON-1080365279 tempest-VolumesSnapshotsTestJSON-1080365279-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/cd9c0d3e-3a87-4703-ab88-4794019e637b" status: 200 len: 286 microversion: 2.1 time: 0.058750 Dec 15 16:24:54.625724 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 265/543] 10.222.0.60 () {58 vars in 1250 bytes} [Wed Dec 15 16:24:54 2021] GET /compute/v2.1/os-snapshots/cd9c0d3e-3a87-4703-ab88-4794019e637b => generated 286 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:24:55.469179 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-7813f352-9237-4966-918a-16feda61712a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:55.470547 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-7813f352-9237-4966-918a-16feda61712a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:55.479317 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7813f352-9237-4966-918a-16feda61712a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:55.479671 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7813f352-9237-4966-918a-16feda61712a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:55.480616 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7813f352-9237-4966-918a-16feda61712a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:55.481070 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7813f352-9237-4966-918a-16feda61712a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:55.623049 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-def7d967-f599-40c4-9bcf-72a5ca7935af tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:55.623810 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-def7d967-f599-40c4-9bcf-72a5ca7935af tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] [instance: 4b73cd2e-45d9-4808-a4d4-db5836234372] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:55.630896 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-def7d967-f599-40c4-9bcf-72a5ca7935af tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:55.631352 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-def7d967-f599-40c4-9bcf-72a5ca7935af tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:55.632199 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-def7d967-f599-40c4-9bcf-72a5ca7935af tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:55.632783 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-def7d967-f599-40c4-9bcf-72a5ca7935af tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:55.654207 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-7813f352-9237-4966-918a-16feda61712a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:55.665911 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-7813f352-9237-4966-918a-16feda61712a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:55.668188 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-7813f352-9237-4966-918a-16feda61712a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:55.669577 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-7813f352-9237-4966-918a-16feda61712a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1405 microversion: 2.20 time: 0.204482 Dec 15 16:24:55.680696 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 279/544] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:24:55 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1405 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:24:55.680696 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-9257d891-81b8-4c3b-ba50-9bf5f7cfffc9 tempest-VolumesSnapshotsTestJSON-1080365279 tempest-VolumesSnapshotsTestJSON-1080365279-project] Calling method '.version_select at 0x7f0b26bd65e0>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:55.709520 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-9257d891-81b8-4c3b-ba50-9bf5f7cfffc9 tempest-VolumesSnapshotsTestJSON-1080365279 tempest-VolumesSnapshotsTestJSON-1080365279-project] HTTP exception thrown: Snapshot cd9c0d3e-3a87-4703-ab88-4794019e637b could not be found. Dec 15 16:24:55.710539 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-9257d891-81b8-4c3b-ba50-9bf5f7cfffc9 tempest-VolumesSnapshotsTestJSON-1080365279 tempest-VolumesSnapshotsTestJSON-1080365279-project] Returning 404 to user: Snapshot cd9c0d3e-3a87-4703-ab88-4794019e637b could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:24:55.711572 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-9257d891-81b8-4c3b-ba50-9bf5f7cfffc9 tempest-VolumesSnapshotsTestJSON-1080365279 tempest-VolumesSnapshotsTestJSON-1080365279-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/cd9c0d3e-3a87-4703-ab88-4794019e637b" status: 404 len: 111 microversion: 2.1 time: 0.039516 Dec 15 16:24:55.712324 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 280/545] 10.222.0.60 () {58 vars in 1250 bytes} [Wed Dec 15 16:24:55 2021] GET /compute/v2.1/os-snapshots/cd9c0d3e-3a87-4703-ab88-4794019e637b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:24:55.720656 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-48d55e08-eb00-4413-a292-683fb050c240 tempest-VolumesSnapshotsTestJSON-1080365279 tempest-VolumesSnapshotsTestJSON-1080365279-project] Calling method '.version_select at 0x7f0b26baaa60>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:55.803186 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-48d55e08-eb00-4413-a292-683fb050c240 tempest-VolumesSnapshotsTestJSON-1080365279 tempest-VolumesSnapshotsTestJSON-1080365279-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/00f8bca7-8c91-4ee5-8eb3-669c99554613" status: 202 len: 0 microversion: 2.1 time: 0.086256 Dec 15 16:24:55.804403 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 281/546] 10.222.0.60 () {58 vars in 1247 bytes} [Wed Dec 15 16:24:55 2021] DELETE /compute/v2.1/os-volumes/00f8bca7-8c91-4ee5-8eb3-669c99554613 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:24:55.818508 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f62abc3d-3759-4210-b8f7-bc28f1aaf032 tempest-VolumesSnapshotsTestJSON-1080365279 tempest-VolumesSnapshotsTestJSON-1080365279-project] Calling method '.version_select at 0x7f0b26b88c10>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:55.849783 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-def7d967-f599-40c4-9bcf-72a5ca7935af tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b8a0a1adc54ff4abafe90692d10543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f435a136a5e44f89a0b09d4ec7427b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:55.861197 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-def7d967-f599-40c4-9bcf-72a5ca7935af tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] 10.222.0.60 "GET /compute/v2.1/servers/4b73cd2e-45d9-4808-a4d4-db5836234372" status: 200 len: 1319 microversion: 2.1 time: 0.242202 Dec 15 16:24:55.873179 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 266/547] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:55 2021] GET /compute/v2.1/servers/4b73cd2e-45d9-4808-a4d4-db5836234372 => generated 1319 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:24:55.893312 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f62abc3d-3759-4210-b8f7-bc28f1aaf032 tempest-VolumesSnapshotsTestJSON-1080365279 tempest-VolumesSnapshotsTestJSON-1080365279-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/00f8bca7-8c91-4ee5-8eb3-669c99554613" status: 200 len: 345 microversion: 2.1 time: 0.080784 Dec 15 16:24:55.894255 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 282/548] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Dec 15 16:24:55 2021] GET /compute/v2.1/os-volumes/00f8bca7-8c91-4ee5-8eb3-669c99554613 => generated 345 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:24:56.064017 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-ba9eb97d-a7ee-4a24-bb79-eaecc01eec0b req-8a05aedf-40fd-4b6c-909c-be0720830d7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b73cd2e-45d9-4808-a4d4-db5836234372", "tag": "ad8b774e-9bea-4fa1-8869-54c2ac4331f0"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:24:56.066789 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:24:56.066789 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Dec 15 16:24:56.074838 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-ba9eb97d-a7ee-4a24-bb79-eaecc01eec0b req-8a05aedf-40fd-4b6c-909c-be0720830d7a service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:56.075300 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-ba9eb97d-a7ee-4a24-bb79-eaecc01eec0b req-8a05aedf-40fd-4b6c-909c-be0720830d7a service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:56.089290 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-ba9eb97d-a7ee-4a24-bb79-eaecc01eec0b req-8a05aedf-40fd-4b6c-909c-be0720830d7a service nova] Creating event network-changed:ad8b774e-9bea-4fa1-8869-54c2ac4331f0 for instance 4b73cd2e-45d9-4808-a4d4-db5836234372 on hv-cinder-81268 Dec 15 16:24:56.094748 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-ba9eb97d-a7ee-4a24-bb79-eaecc01eec0b req-8a05aedf-40fd-4b6c-909c-be0720830d7a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035319 Dec 15 16:24:56.095753 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 267/549] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:24:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:24:56.689723 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-fed8014c-f378-483f-a9c4-7d884fccd293 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:56.691302 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-fed8014c-f378-483f-a9c4-7d884fccd293 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:56.698961 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fed8014c-f378-483f-a9c4-7d884fccd293 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:56.699833 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fed8014c-f378-483f-a9c4-7d884fccd293 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:56.701053 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fed8014c-f378-483f-a9c4-7d884fccd293 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:56.701436 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fed8014c-f378-483f-a9c4-7d884fccd293 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:56.891507 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-fed8014c-f378-483f-a9c4-7d884fccd293 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:56.899132 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-c6dc9e8c-a29c-4624-a4c8-0a165e33b220 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:56.902820 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-c6dc9e8c-a29c-4624-a4c8-0a165e33b220 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] [instance: 4b73cd2e-45d9-4808-a4d4-db5836234372] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:56.913104 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-fed8014c-f378-483f-a9c4-7d884fccd293 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:56.919764 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-fed8014c-f378-483f-a9c4-7d884fccd293 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:56.921818 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-fed8014c-f378-483f-a9c4-7d884fccd293 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1597 microversion: 2.20 time: 0.236940 Dec 15 16:24:56.922893 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 283/550] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:24:56 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1597 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:24:56.923678 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c6dc9e8c-a29c-4624-a4c8-0a165e33b220 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:56.924125 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c6dc9e8c-a29c-4624-a4c8-0a165e33b220 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:56.924972 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c6dc9e8c-a29c-4624-a4c8-0a165e33b220 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:56.925418 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c6dc9e8c-a29c-4624-a4c8-0a165e33b220 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:56.931662 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0588dea9-555b-4d30-85ff-e8f8673ed8fd tempest-VolumesSnapshotsTestJSON-1080365279 tempest-VolumesSnapshotsTestJSON-1080365279-project] Calling method '.version_select at 0x7f0b26ae2a60>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:56.966622 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-0588dea9-555b-4d30-85ff-e8f8673ed8fd tempest-VolumesSnapshotsTestJSON-1080365279 tempest-VolumesSnapshotsTestJSON-1080365279-project] HTTP exception thrown: Volume 00f8bca7-8c91-4ee5-8eb3-669c99554613 could not be found. Dec 15 16:24:56.967420 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0588dea9-555b-4d30-85ff-e8f8673ed8fd tempest-VolumesSnapshotsTestJSON-1080365279 tempest-VolumesSnapshotsTestJSON-1080365279-project] Returning 404 to user: Volume 00f8bca7-8c91-4ee5-8eb3-669c99554613 could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:24:56.968269 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0588dea9-555b-4d30-85ff-e8f8673ed8fd tempest-VolumesSnapshotsTestJSON-1080365279 tempest-VolumesSnapshotsTestJSON-1080365279-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/00f8bca7-8c91-4ee5-8eb3-669c99554613" status: 404 len: 109 microversion: 2.1 time: 0.043418 Dec 15 16:24:56.969002 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 284/551] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Dec 15 16:24:56 2021] GET /compute/v2.1/os-volumes/00f8bca7-8c91-4ee5-8eb3-669c99554613 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:24:56.975461 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1ca1ab5c-2599-4e91-8c66-613c8e0eb295 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:56.976233 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1ca1ab5c-2599-4e91-8c66-613c8e0eb295 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:56.986864 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1ca1ab5c-2599-4e91-8c66-613c8e0eb295 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:56.987732 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1ca1ab5c-2599-4e91-8c66-613c8e0eb295 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:56.988711 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1ca1ab5c-2599-4e91-8c66-613c8e0eb295 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:56.989317 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1ca1ab5c-2599-4e91-8c66-613c8e0eb295 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:57.091407 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1ca1ab5c-2599-4e91-8c66-613c8e0eb295 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.120552 Dec 15 16:24:57.100625 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 285/552] 10.222.0.60 () {60 vars in 1315 bytes} [Wed Dec 15 16:24:56 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/os-interface => generated 285 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:24:57.111298 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-77b85757-97dd-42fe-abe1-41b85480161e tempest-VolumesSnapshotsTestJSON-1080365279 tempest-VolumesSnapshotsTestJSON-1080365279-project] Calling method '.version_select at 0x7f0b26ae29d0>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:57.161572 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-77b85757-97dd-42fe-abe1-41b85480161e tempest-VolumesSnapshotsTestJSON-1080365279 tempest-VolumesSnapshotsTestJSON-1080365279-project] HTTP exception thrown: Volume 00f8bca7-8c91-4ee5-8eb3-669c99554613 could not be found. Dec 15 16:24:57.162204 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-77b85757-97dd-42fe-abe1-41b85480161e tempest-VolumesSnapshotsTestJSON-1080365279 tempest-VolumesSnapshotsTestJSON-1080365279-project] Returning 404 to user: Volume 00f8bca7-8c91-4ee5-8eb3-669c99554613 could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:24:57.163042 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-77b85757-97dd-42fe-abe1-41b85480161e tempest-VolumesSnapshotsTestJSON-1080365279 tempest-VolumesSnapshotsTestJSON-1080365279-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/00f8bca7-8c91-4ee5-8eb3-669c99554613" status: 404 len: 109 microversion: 2.1 time: 0.059520 Dec 15 16:24:57.163686 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 286/553] 10.222.0.60 () {58 vars in 1247 bytes} [Wed Dec 15 16:24:57 2021] DELETE /compute/v2.1/os-volumes/00f8bca7-8c91-4ee5-8eb3-669c99554613 => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:24:57.171652 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-4342f1c8-b5c1-41c8-80d4-141c2809eb98 tempest-VolumesSnapshotsTestJSON-1080365279 tempest-VolumesSnapshotsTestJSON-1080365279-project] Calling method '.version_select at 0x7f0b26a7de50>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:57.181008 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-c6dc9e8c-a29c-4624-a4c8-0a165e33b220 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b8a0a1adc54ff4abafe90692d10543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f435a136a5e44f89a0b09d4ec7427b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:57.193550 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-c6dc9e8c-a29c-4624-a4c8-0a165e33b220 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] 10.222.0.60 "GET /compute/v2.1/servers/4b73cd2e-45d9-4808-a4d4-db5836234372" status: 200 len: 1319 microversion: 2.1 time: 0.315259 Dec 15 16:24:57.194273 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 268/554] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:56 2021] GET /compute/v2.1/servers/4b73cd2e-45d9-4808-a4d4-db5836234372 => generated 1319 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:24:57.204277 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-4342f1c8-b5c1-41c8-80d4-141c2809eb98 tempest-VolumesSnapshotsTestJSON-1080365279 tempest-VolumesSnapshotsTestJSON-1080365279-project] HTTP exception thrown: Volume 00f8bca7-8c91-4ee5-8eb3-669c99554613 could not be found. Dec 15 16:24:57.205155 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-4342f1c8-b5c1-41c8-80d4-141c2809eb98 tempest-VolumesSnapshotsTestJSON-1080365279 tempest-VolumesSnapshotsTestJSON-1080365279-project] Returning 404 to user: Volume 00f8bca7-8c91-4ee5-8eb3-669c99554613 could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:24:57.206119 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-4342f1c8-b5c1-41c8-80d4-141c2809eb98 tempest-VolumesSnapshotsTestJSON-1080365279 tempest-VolumesSnapshotsTestJSON-1080365279-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/00f8bca7-8c91-4ee5-8eb3-669c99554613" status: 404 len: 109 microversion: 2.1 time: 0.038004 Dec 15 16:24:57.206814 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 287/555] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Dec 15 16:24:57 2021] GET /compute/v2.1/os-volumes/00f8bca7-8c91-4ee5-8eb3-669c99554613 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:24:58.214987 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-653dcd00-b8c4-4fad-a211-b9b8767d1eca tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:58.216069 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-653dcd00-b8c4-4fad-a211-b9b8767d1eca tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] [instance: 4b73cd2e-45d9-4808-a4d4-db5836234372] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:58.227575 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-653dcd00-b8c4-4fad-a211-b9b8767d1eca tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:58.228511 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-653dcd00-b8c4-4fad-a211-b9b8767d1eca tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:58.230365 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-653dcd00-b8c4-4fad-a211-b9b8767d1eca tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:58.231065 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-653dcd00-b8c4-4fad-a211-b9b8767d1eca tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:58.519164 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-653dcd00-b8c4-4fad-a211-b9b8767d1eca tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b8a0a1adc54ff4abafe90692d10543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f435a136a5e44f89a0b09d4ec7427b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:58.527384 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-653dcd00-b8c4-4fad-a211-b9b8767d1eca tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] 10.222.0.60 "GET /compute/v2.1/servers/4b73cd2e-45d9-4808-a4d4-db5836234372" status: 200 len: 1319 microversion: 2.1 time: 0.318199 Dec 15 16:24:58.528334 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 269/556] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:58 2021] GET /compute/v2.1/servers/4b73cd2e-45d9-4808-a4d4-db5836234372 => generated 1319 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:58.607961 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-2a7959f2-3117-4c2b-8f3a-283a17f6a8bd tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:24:58.609009 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-2a7959f2-3117-4c2b-8f3a-283a17f6a8bd tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:58.615241 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-5c809774-c77c-4aff-b159-e39e907b5d9e req-5d05cacb-e7c5-475a-8ae3-f29333f23731 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "049761b5-88eb-4325-af0e-03da2842cbf5", "tag": "71e495aa-7e03-4d0e-9f9d-b7560a684e27"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:24:58.616656 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2a7959f2-3117-4c2b-8f3a-283a17f6a8bd tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:58.616656 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2a7959f2-3117-4c2b-8f3a-283a17f6a8bd tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:58.617452 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2a7959f2-3117-4c2b-8f3a-283a17f6a8bd tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:58.617886 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2a7959f2-3117-4c2b-8f3a-283a17f6a8bd tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:58.618734 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:24:58.618734 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Dec 15 16:24:58.630137 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-5c809774-c77c-4aff-b159-e39e907b5d9e req-5d05cacb-e7c5-475a-8ae3-f29333f23731 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:58.630483 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-5c809774-c77c-4aff-b159-e39e907b5d9e req-5d05cacb-e7c5-475a-8ae3-f29333f23731 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:58.648378 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-5c809774-c77c-4aff-b159-e39e907b5d9e req-5d05cacb-e7c5-475a-8ae3-f29333f23731 service nova] Creating event network-changed:71e495aa-7e03-4d0e-9f9d-b7560a684e27 for instance 049761b5-88eb-4325-af0e-03da2842cbf5 on hv-cinder-81268 Dec 15 16:24:58.656125 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-5c809774-c77c-4aff-b159-e39e907b5d9e req-5d05cacb-e7c5-475a-8ae3-f29333f23731 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045286 Dec 15 16:24:58.657622 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 270/557] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:24:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:24:58.697788 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-2a7959f2-3117-4c2b-8f3a-283a17f6a8bd tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action" status: 200 len: 14 microversion: 2.20 time: 0.094115 Dec 15 16:24:58.700518 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 288/558] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:24:58 2021] POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:24:59.549510 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-17eb3ccd-d486-4674-acae-19d6457e1fe7 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:24:59.550754 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-17eb3ccd-d486-4674-acae-19d6457e1fe7 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] [instance: 4b73cd2e-45d9-4808-a4d4-db5836234372] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:59.561037 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-17eb3ccd-d486-4674-acae-19d6457e1fe7 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:59.561708 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-17eb3ccd-d486-4674-acae-19d6457e1fe7 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:59.563814 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-17eb3ccd-d486-4674-acae-19d6457e1fe7 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:59.564410 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-17eb3ccd-d486-4674-acae-19d6457e1fe7 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:59.711032 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-feff7f0a-35cc-4be8-9878-77d1fb2875ba tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:24:59.712855 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-feff7f0a-35cc-4be8-9878-77d1fb2875ba tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:24:59.720270 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-feff7f0a-35cc-4be8-9878-77d1fb2875ba tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:59.721135 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-feff7f0a-35cc-4be8-9878-77d1fb2875ba tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:59.722204 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-feff7f0a-35cc-4be8-9878-77d1fb2875ba tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:24:59.723253 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-feff7f0a-35cc-4be8-9878-77d1fb2875ba tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:24:59.735989 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-17eb3ccd-d486-4674-acae-19d6457e1fe7 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b8a0a1adc54ff4abafe90692d10543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f435a136a5e44f89a0b09d4ec7427b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:24:59.744598 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-17eb3ccd-d486-4674-acae-19d6457e1fe7 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] 10.222.0.60 "GET /compute/v2.1/servers/4b73cd2e-45d9-4808-a4d4-db5836234372" status: 200 len: 1319 microversion: 2.1 time: 0.203081 Dec 15 16:24:59.745837 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 271/559] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:24:59 2021] GET /compute/v2.1/servers/4b73cd2e-45d9-4808-a4d4-db5836234372 => generated 1319 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:24:59.808937 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-feff7f0a-35cc-4be8-9878-77d1fb2875ba tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action" status: 200 len: 14 microversion: 2.20 time: 0.102726 Dec 15 16:24:59.810128 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 289/560] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:24:59 2021] POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:00.561617 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-8bff4f5a-72d7-425c-a312-34c1f8f1b86f tempest-VolumesTestJSON-895993399 tempest-VolumesTestJSON-895993399-project] Calling method '.version_select at 0x7f0b26bde0d0>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:00.624794 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-8bff4f5a-72d7-425c-a312-34c1f8f1b86f tempest-VolumesTestJSON-895993399 tempest-VolumesTestJSON-895993399-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/86fe6fdb-84ab-4634-a7f8-f5fef549c5d0" status: 200 len: 351 microversion: 2.1 time: 0.067448 Dec 15 16:25:00.625569 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 272/561] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Dec 15 16:25:00 2021] GET /compute/v2.1/os-volumes/86fe6fdb-84ab-4634-a7f8-f5fef549c5d0 => generated 351 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:25:00.762884 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d4e0b09b-447e-4826-81cf-db2022b65a44 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:00.763935 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d4e0b09b-447e-4826-81cf-db2022b65a44 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] [instance: 4b73cd2e-45d9-4808-a4d4-db5836234372] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:00.772825 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d4e0b09b-447e-4826-81cf-db2022b65a44 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:00.773459 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d4e0b09b-447e-4826-81cf-db2022b65a44 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:00.774661 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d4e0b09b-447e-4826-81cf-db2022b65a44 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:00.775494 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d4e0b09b-447e-4826-81cf-db2022b65a44 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:00.822688 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-39aa6ce4-282b-4c6b-badd-9d420bd9e59c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:25:00.823662 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-39aa6ce4-282b-4c6b-badd-9d420bd9e59c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:00.831713 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-39aa6ce4-282b-4c6b-badd-9d420bd9e59c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:00.832300 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-39aa6ce4-282b-4c6b-badd-9d420bd9e59c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:00.833155 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-39aa6ce4-282b-4c6b-badd-9d420bd9e59c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:00.833591 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-39aa6ce4-282b-4c6b-badd-9d420bd9e59c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:00.915155 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-39aa6ce4-282b-4c6b-badd-9d420bd9e59c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action" status: 200 len: 14 microversion: 2.20 time: 0.095852 Dec 15 16:25:00.916300 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 273/562] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:25:00 2021] POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:25:00.972506 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-391b8f4b-ffd7-49aa-88a8-5aab69cfb984 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:25:00.980330 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-391b8f4b-ffd7-49aa-88a8-5aab69cfb984 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:00.980727 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-391b8f4b-ffd7-49aa-88a8-5aab69cfb984 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:00.980846 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d4e0b09b-447e-4826-81cf-db2022b65a44 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b8a0a1adc54ff4abafe90692d10543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f435a136a5e44f89a0b09d4ec7427b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:00.994017 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d4e0b09b-447e-4826-81cf-db2022b65a44 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] 10.222.0.60 "GET /compute/v2.1/servers/4b73cd2e-45d9-4808-a4d4-db5836234372" status: 200 len: 1319 microversion: 2.1 time: 0.235226 Dec 15 16:25:00.995407 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 290/563] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:00 2021] GET /compute/v2.1/servers/4b73cd2e-45d9-4808-a4d4-db5836234372 => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:01.008182 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-391b8f4b-ffd7-49aa-88a8-5aab69cfb984 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Going to try to stop instance {{(pid=116085) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 15 16:25:01.056891 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-391b8f4b-ffd7-49aa-88a8-5aab69cfb984 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action" status: 202 len: 0 microversion: 2.1 time: 0.088327 Dec 15 16:25:01.057829 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 274/564] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:25:00 2021] POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:25:01.067287 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e727fe33-18d7-4689-a589-25ab072955dd tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:01.067930 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e727fe33-18d7-4689-a589-25ab072955dd tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:01.075750 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e727fe33-18d7-4689-a589-25ab072955dd tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:01.076201 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e727fe33-18d7-4689-a589-25ab072955dd tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:01.077738 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e727fe33-18d7-4689-a589-25ab072955dd tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:01.078175 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e727fe33-18d7-4689-a589-25ab072955dd tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:01.235316 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e727fe33-18d7-4689-a589-25ab072955dd tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:01.243253 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e727fe33-18d7-4689-a589-25ab072955dd tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1677 microversion: 2.1 time: 0.179772 Dec 15 16:25:01.243920 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 291/565] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:01 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1677 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:25:01.930147 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-023e4427-0a4b-43e1-b887-d3146fca13e5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:25:01.931472 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-023e4427-0a4b-43e1-b887-d3146fca13e5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:01.939602 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-023e4427-0a4b-43e1-b887-d3146fca13e5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:01.939901 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-023e4427-0a4b-43e1-b887-d3146fca13e5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:01.941056 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-023e4427-0a4b-43e1-b887-d3146fca13e5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:01.941553 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-023e4427-0a4b-43e1-b887-d3146fca13e5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:02.017186 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-09001d7b-440f-4b88-9d4b-868c660b532d tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:02.018192 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-09001d7b-440f-4b88-9d4b-868c660b532d tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] [instance: 4b73cd2e-45d9-4808-a4d4-db5836234372] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:02.024726 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-023e4427-0a4b-43e1-b887-d3146fca13e5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action" status: 200 len: 14 microversion: 2.20 time: 0.099173 Dec 15 16:25:02.025888 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 275/566] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:25:01 2021] POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:02.033527 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-1dd69265-562f-47ae-8195-a1a813d3d3d5 tempest-VolumesTestJSON-895993399 tempest-VolumesTestJSON-895993399-project] Calling method '.version_select at 0x7f0b26a31a60>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:02.039363 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-09001d7b-440f-4b88-9d4b-868c660b532d tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:02.040110 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-09001d7b-440f-4b88-9d4b-868c660b532d tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:02.041285 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-09001d7b-440f-4b88-9d4b-868c660b532d tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:02.041873 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-09001d7b-440f-4b88-9d4b-868c660b532d tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:02.097920 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-1dd69265-562f-47ae-8195-a1a813d3d3d5 tempest-VolumesTestJSON-895993399 tempest-VolumesTestJSON-895993399-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/4ab81a7c-96af-4a84-b7e2-3fd1977cb9f3" status: 200 len: 351 microversion: 2.1 time: 0.070189 Dec 15 16:25:02.098602 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 276/567] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Dec 15 16:25:02 2021] GET /compute/v2.1/os-volumes/4ab81a7c-96af-4a84-b7e2-3fd1977cb9f3 => generated 351 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:25:02.110001 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-97cdfee9-ded9-4f67-bbaf-4e1cc57065ab req-6bd6df78-85c1-41e9-936e-b20d949f26aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b73cd2e-45d9-4808-a4d4-db5836234372", "name": "network-vif-plugged", "status": "completed", "tag": "ad8b774e-9bea-4fa1-8869-54c2ac4331f0"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:25:02.111989 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:25:02.111989 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Dec 15 16:25:02.121863 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-97cdfee9-ded9-4f67-bbaf-4e1cc57065ab req-6bd6df78-85c1-41e9-936e-b20d949f26aa service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:02.122305 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-97cdfee9-ded9-4f67-bbaf-4e1cc57065ab req-6bd6df78-85c1-41e9-936e-b20d949f26aa service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:02.136034 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-97cdfee9-ded9-4f67-bbaf-4e1cc57065ab req-6bd6df78-85c1-41e9-936e-b20d949f26aa service nova] Creating event network-vif-plugged:ad8b774e-9bea-4fa1-8869-54c2ac4331f0 for instance 4b73cd2e-45d9-4808-a4d4-db5836234372 on hv-cinder-81268 Dec 15 16:25:02.141722 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-97cdfee9-ded9-4f67-bbaf-4e1cc57065ab req-6bd6df78-85c1-41e9-936e-b20d949f26aa service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035055 Dec 15 16:25:02.142322 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 277/568] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:25:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:25:02.261454 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-09001d7b-440f-4b88-9d4b-868c660b532d tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b8a0a1adc54ff4abafe90692d10543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f435a136a5e44f89a0b09d4ec7427b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:02.261690 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-8f8cb1c2-96f7-4f34-a3db-384d58826ecc tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:02.262393 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-8f8cb1c2-96f7-4f34-a3db-384d58826ecc tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:02.273702 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8f8cb1c2-96f7-4f34-a3db-384d58826ecc tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:02.274040 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-09001d7b-440f-4b88-9d4b-868c660b532d tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] 10.222.0.60 "GET /compute/v2.1/servers/4b73cd2e-45d9-4808-a4d4-db5836234372" status: 200 len: 1319 microversion: 2.1 time: 0.260296 Dec 15 16:25:02.274304 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8f8cb1c2-96f7-4f34-a3db-384d58826ecc tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:02.275481 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8f8cb1c2-96f7-4f34-a3db-384d58826ecc tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:02.276085 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8f8cb1c2-96f7-4f34-a3db-384d58826ecc tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:02.276455 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 292/569] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:02 2021] GET /compute/v2.1/servers/4b73cd2e-45d9-4808-a4d4-db5836234372 => generated 1319 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:25:02.465510 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-8f8cb1c2-96f7-4f34-a3db-384d58826ecc tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:02.478078 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-8f8cb1c2-96f7-4f34-a3db-384d58826ecc tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1677 microversion: 2.1 time: 0.220645 Dec 15 16:25:02.479605 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 278/570] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:02 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1677 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:25:03.040075 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-8a607419-198d-4099-9683-fa7fc5972c4a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:25:03.041553 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-8a607419-198d-4099-9683-fa7fc5972c4a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:03.052256 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8a607419-198d-4099-9683-fa7fc5972c4a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:03.052707 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8a607419-198d-4099-9683-fa7fc5972c4a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:03.053498 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8a607419-198d-4099-9683-fa7fc5972c4a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:03.053933 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8a607419-198d-4099-9683-fa7fc5972c4a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:03.117726 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-8a607419-198d-4099-9683-fa7fc5972c4a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action" status: 200 len: 14 microversion: 2.20 time: 0.084605 Dec 15 16:25:03.118392 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 293/571] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:25:03 2021] POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:03.298965 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-9f447343-615f-413c-9b72-5ffbb3ad3d8b tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:03.299707 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-9f447343-615f-413c-9b72-5ffbb3ad3d8b tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] [instance: 4b73cd2e-45d9-4808-a4d4-db5836234372] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:03.316744 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9f447343-615f-413c-9b72-5ffbb3ad3d8b tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:03.317198 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9f447343-615f-413c-9b72-5ffbb3ad3d8b tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:03.318002 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9f447343-615f-413c-9b72-5ffbb3ad3d8b tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:03.318440 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9f447343-615f-413c-9b72-5ffbb3ad3d8b tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:03.467967 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-9f447343-615f-413c-9b72-5ffbb3ad3d8b tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b8a0a1adc54ff4abafe90692d10543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f435a136a5e44f89a0b09d4ec7427b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:03.485318 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-9f447343-615f-413c-9b72-5ffbb3ad3d8b tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] 10.222.0.60 "GET /compute/v2.1/servers/4b73cd2e-45d9-4808-a4d4-db5836234372" status: 200 len: 1319 microversion: 2.1 time: 0.192271 Dec 15 16:25:03.485880 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 279/572] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:03 2021] GET /compute/v2.1/servers/4b73cd2e-45d9-4808-a4d4-db5836234372 => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:03.497814 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-56b163c5-c1a9-4fd6-aa12-e2023243e5f5 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:03.498500 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-56b163c5-c1a9-4fd6-aa12-e2023243e5f5 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:03.506157 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-56b163c5-c1a9-4fd6-aa12-e2023243e5f5 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:03.506597 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-56b163c5-c1a9-4fd6-aa12-e2023243e5f5 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:03.507400 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-56b163c5-c1a9-4fd6-aa12-e2023243e5f5 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:03.507865 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-56b163c5-c1a9-4fd6-aa12-e2023243e5f5 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:03.601473 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-ad9d8be3-2782-4926-90e0-225b55ad05c2 tempest-VolumesTestJSON-895993399 tempest-VolumesTestJSON-895993399-project] Calling method '.version_select at 0x7f0b26a51040>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:03.670962 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-ad9d8be3-2782-4926-90e0-225b55ad05c2 tempest-VolumesTestJSON-895993399 tempest-VolumesTestJSON-895993399-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/d53e66d7-6f08-444a-8c5c-cecd6befbc36" status: 200 len: 350 microversion: 2.1 time: 0.073301 Dec 15 16:25:03.671579 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 280/573] 10.222.0.60 () {58 vars in 1244 bytes} [Wed Dec 15 16:25:03 2021] GET /compute/v2.1/os-volumes/d53e66d7-6f08-444a-8c5c-cecd6befbc36 => generated 350 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:25:03.681609 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-56b163c5-c1a9-4fd6-aa12-e2023243e5f5 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:03.682825 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-cf5996f1-0b33-434a-ab2a-99cee160c459 tempest-VolumesTestJSON-895993399 tempest-VolumesTestJSON-895993399-project] Calling method '.version_select at 0x7f0b26a6eca0>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:03.694123 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-56b163c5-c1a9-4fd6-aa12-e2023243e5f5 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1677 microversion: 2.1 time: 0.200333 Dec 15 16:25:03.694811 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 294/574] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:03 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1677 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:03.774755 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-cf5996f1-0b33-434a-ab2a-99cee160c459 tempest-VolumesTestJSON-895993399 tempest-VolumesTestJSON-895993399-project] 10.222.0.60 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.095382 Dec 15 16:25:03.775544 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 281/575] 10.222.0.60 () {58 vars in 1133 bytes} [Wed Dec 15 16:25:03 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:25:03.789239 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-7417eaf5-dd11-449e-9158-bfdb6e650b78 tempest-VolumesTestJSON-895993399 tempest-VolumesTestJSON-895993399-project] Calling method '.version_select at 0x7f0b26a95d30>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:03.873080 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-7417eaf5-dd11-449e-9158-bfdb6e650b78 tempest-VolumesTestJSON-895993399 tempest-VolumesTestJSON-895993399-project] 10.222.0.60 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.087665 Dec 15 16:25:03.873658 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 295/576] 10.222.0.60 () {58 vars in 1148 bytes} [Wed Dec 15 16:25:03 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:25:03.886190 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-1be8cf41-8290-45fa-823e-bf907b83c184 tempest-VolumesTestJSON-895993399 tempest-VolumesTestJSON-895993399-project] Calling method '.version_select at 0x7f0b26a8f820>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:03.969669 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-1be8cf41-8290-45fa-823e-bf907b83c184 tempest-VolumesTestJSON-895993399 tempest-VolumesTestJSON-895993399-project] 10.222.0.60 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.087474 Dec 15 16:25:03.970381 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 282/577] 10.222.0.60 () {58 vars in 1133 bytes} [Wed Dec 15 16:25:03 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:25:03.982243 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-7e697022-1b6d-4e53-bf29-ea8935a1b8e5 tempest-VolumesTestJSON-895993399 tempest-VolumesTestJSON-895993399-project] Calling method '.version_select at 0x7f0b26a915e0>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:04.103349 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-7e697022-1b6d-4e53-bf29-ea8935a1b8e5 tempest-VolumesTestJSON-895993399 tempest-VolumesTestJSON-895993399-project] 10.222.0.60 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.124929 Dec 15 16:25:04.104509 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 296/578] 10.222.0.60 () {58 vars in 1166 bytes} [Wed Dec 15 16:25:03 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:25:04.116682 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-0afa8615-cb71-48b2-b3c1-1cf112bf49d7 tempest-VolumesTestJSON-895993399 tempest-VolumesTestJSON-895993399-project] Calling method '.version_select at 0x7f0b26a6e5e0>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:04.130300 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c96f68a0-60cb-440b-87d8-4eb72cf46725 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:25:04.131337 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c96f68a0-60cb-440b-87d8-4eb72cf46725 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:04.138648 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c96f68a0-60cb-440b-87d8-4eb72cf46725 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:04.139105 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c96f68a0-60cb-440b-87d8-4eb72cf46725 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:04.139972 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c96f68a0-60cb-440b-87d8-4eb72cf46725 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:04.140390 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c96f68a0-60cb-440b-87d8-4eb72cf46725 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:04.205529 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-0afa8615-cb71-48b2-b3c1-1cf112bf49d7 tempest-VolumesTestJSON-895993399 tempest-VolumesTestJSON-895993399-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.092794 Dec 15 16:25:04.206332 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 283/579] 10.222.0.60 () {58 vars in 1169 bytes} [Wed Dec 15 16:25:04 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:25:04.212085 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c96f68a0-60cb-440b-87d8-4eb72cf46725 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action" status: 200 len: 14 microversion: 2.20 time: 0.085456 Dec 15 16:25:04.213133 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 297/580] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:25:04 2021] POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:04.219155 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-371feb9f-24c1-4c31-afbc-42633e93f9f0 tempest-VolumesTestJSON-895993399 tempest-VolumesTestJSON-895993399-project] Calling method '.version_select at 0x7f0b26a51430>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:04.310639 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-371feb9f-24c1-4c31-afbc-42633e93f9f0 tempest-VolumesTestJSON-895993399 tempest-VolumesTestJSON-895993399-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.095015 Dec 15 16:25:04.311292 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 284/581] 10.222.0.60 () {58 vars in 1154 bytes} [Wed Dec 15 16:25:04 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:04.324409 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-7be29755-8252-4668-a55a-5533209cdcc4 tempest-VolumesTestJSON-895993399 tempest-VolumesTestJSON-895993399-project] Calling method '.version_select at 0x7f0b26aa20d0>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:04.444144 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-7be29755-8252-4668-a55a-5533209cdcc4 tempest-VolumesTestJSON-895993399 tempest-VolumesTestJSON-895993399-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.123760 Dec 15 16:25:04.444727 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 298/582] 10.222.0.60 () {58 vars in 1187 bytes} [Wed Dec 15 16:25:04 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:25:04.456331 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-7d6093b2-78ea-4a6c-ba73-883e323774bd tempest-VolumesTestJSON-895993399 tempest-VolumesTestJSON-895993399-project] Calling method '.version_select at 0x7f0b26a8f040>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:04.505118 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-cc06ca66-966e-45ad-91f1-977cda631c98 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:04.505871 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-cc06ca66-966e-45ad-91f1-977cda631c98 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] [instance: 4b73cd2e-45d9-4808-a4d4-db5836234372] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:04.512969 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cc06ca66-966e-45ad-91f1-977cda631c98 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:04.513424 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cc06ca66-966e-45ad-91f1-977cda631c98 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:04.514238 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cc06ca66-966e-45ad-91f1-977cda631c98 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:04.514672 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cc06ca66-966e-45ad-91f1-977cda631c98 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:04.544361 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-7d6093b2-78ea-4a6c-ba73-883e323774bd tempest-VolumesTestJSON-895993399 tempest-VolumesTestJSON-895993399-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.091675 Dec 15 16:25:04.544933 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 285/583] 10.222.0.60 () {58 vars in 1154 bytes} [Wed Dec 15 16:25:04 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:25:04.701168 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-cc06ca66-966e-45ad-91f1-977cda631c98 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b8a0a1adc54ff4abafe90692d10543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f435a136a5e44f89a0b09d4ec7427b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:04.710387 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-cc06ca66-966e-45ad-91f1-977cda631c98 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] 10.222.0.60 "GET /compute/v2.1/servers/4b73cd2e-45d9-4808-a4d4-db5836234372" status: 200 len: 1507 microversion: 2.1 time: 0.210328 Dec 15 16:25:04.710973 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 299/584] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:04 2021] GET /compute/v2.1/servers/4b73cd2e-45d9-4808-a4d4-db5836234372 => generated 1507 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:04.712152 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-5d19d60d-99c5-4b26-b71b-9043a13a1f3f tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:04.712790 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-5d19d60d-99c5-4b26-b71b-9043a13a1f3f tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:04.719154 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5d19d60d-99c5-4b26-b71b-9043a13a1f3f tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:04.719642 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5d19d60d-99c5-4b26-b71b-9043a13a1f3f tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:04.720432 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5d19d60d-99c5-4b26-b71b-9043a13a1f3f tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:04.720864 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5d19d60d-99c5-4b26-b71b-9043a13a1f3f tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:04.890008 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-5d19d60d-99c5-4b26-b71b-9043a13a1f3f tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:04.904084 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-5d19d60d-99c5-4b26-b71b-9043a13a1f3f tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1677 microversion: 2.1 time: 0.195700 Dec 15 16:25:04.926558 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 286/585] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:04 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1677 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:25:05.230532 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-927ca3d9-936c-42d4-af4b-7b89f04461ae tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:25:05.231604 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-927ca3d9-936c-42d4-af4b-7b89f04461ae tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:05.238965 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-927ca3d9-936c-42d4-af4b-7b89f04461ae tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:05.240323 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-927ca3d9-936c-42d4-af4b-7b89f04461ae tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:05.240323 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-927ca3d9-936c-42d4-af4b-7b89f04461ae tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:05.240684 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-927ca3d9-936c-42d4-af4b-7b89f04461ae tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:05.306942 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-927ca3d9-936c-42d4-af4b-7b89f04461ae tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action" status: 200 len: 14 microversion: 2.20 time: 0.083921 Dec 15 16:25:05.307692 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 300/586] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:25:05 2021] POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:05.934901 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-04389546-8e94-4189-9976-f776255dbbc3 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:05.935587 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-04389546-8e94-4189-9976-f776255dbbc3 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:05.943468 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-04389546-8e94-4189-9976-f776255dbbc3 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:05.944006 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-04389546-8e94-4189-9976-f776255dbbc3 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:05.944809 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-04389546-8e94-4189-9976-f776255dbbc3 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:05.945299 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-04389546-8e94-4189-9976-f776255dbbc3 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:06.113023 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-04389546-8e94-4189-9976-f776255dbbc3 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:06.121379 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-04389546-8e94-4189-9976-f776255dbbc3 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1677 microversion: 2.1 time: 0.190862 Dec 15 16:25:06.121973 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 287/587] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:05 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1677 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:06.323446 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-cb812071-eaeb-4654-8b8d-84420630b83d tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:25:06.324524 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-cb812071-eaeb-4654-8b8d-84420630b83d tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:06.332721 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cb812071-eaeb-4654-8b8d-84420630b83d tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:06.333168 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cb812071-eaeb-4654-8b8d-84420630b83d tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:06.333981 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cb812071-eaeb-4654-8b8d-84420630b83d tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:06.334413 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cb812071-eaeb-4654-8b8d-84420630b83d tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:06.402396 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-cb812071-eaeb-4654-8b8d-84420630b83d tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action" status: 200 len: 14 microversion: 2.20 time: 0.086239 Dec 15 16:25:06.403247 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 301/588] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:25:06 2021] POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:07.138433 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-068c0923-c153-4542-82fe-32640a115e2e tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:07.139145 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-068c0923-c153-4542-82fe-32640a115e2e tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:07.147144 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-068c0923-c153-4542-82fe-32640a115e2e tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:07.147917 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-068c0923-c153-4542-82fe-32640a115e2e tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:07.148824 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-068c0923-c153-4542-82fe-32640a115e2e tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:07.149265 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-068c0923-c153-4542-82fe-32640a115e2e tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:07.357309 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-068c0923-c153-4542-82fe-32640a115e2e tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:07.365839 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-068c0923-c153-4542-82fe-32640a115e2e tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1677 microversion: 2.1 time: 0.231241 Dec 15 16:25:07.366506 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 288/589] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:07 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1677 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:07.414979 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-9c26a0bb-6ef3-4ed7-b594-57b6273075bc tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:25:07.415954 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-9c26a0bb-6ef3-4ed7-b594-57b6273075bc tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:07.424180 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9c26a0bb-6ef3-4ed7-b594-57b6273075bc tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:07.424633 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9c26a0bb-6ef3-4ed7-b594-57b6273075bc tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:07.425674 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9c26a0bb-6ef3-4ed7-b594-57b6273075bc tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:07.426089 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9c26a0bb-6ef3-4ed7-b594-57b6273075bc tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:07.508837 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-9c26a0bb-6ef3-4ed7-b594-57b6273075bc tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action" status: 200 len: 14 microversion: 2.20 time: 0.098040 Dec 15 16:25:07.509516 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 302/590] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:25:07 2021] POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:25:08.383901 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-dc0d4f27-5983-4e5c-811c-abe98ce19df6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:08.384612 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-dc0d4f27-5983-4e5c-811c-abe98ce19df6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:08.399305 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-dc0d4f27-5983-4e5c-811c-abe98ce19df6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:08.399936 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-dc0d4f27-5983-4e5c-811c-abe98ce19df6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:08.400819 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-dc0d4f27-5983-4e5c-811c-abe98ce19df6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:08.401283 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-dc0d4f27-5983-4e5c-811c-abe98ce19df6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:08.523301 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c85a6bc1-c603-4c84-906a-e1d73fcc8df4 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:25:08.525085 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c85a6bc1-c603-4c84-906a-e1d73fcc8df4 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:08.533538 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c85a6bc1-c603-4c84-906a-e1d73fcc8df4 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:08.534273 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c85a6bc1-c603-4c84-906a-e1d73fcc8df4 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:08.535353 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c85a6bc1-c603-4c84-906a-e1d73fcc8df4 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:08.536527 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c85a6bc1-c603-4c84-906a-e1d73fcc8df4 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:08.610285 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c85a6bc1-c603-4c84-906a-e1d73fcc8df4 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action" status: 200 len: 14 microversion: 2.20 time: 0.093208 Dec 15 16:25:08.611255 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 303/591] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:25:08 2021] POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:08.652240 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-dc0d4f27-5983-4e5c-811c-abe98ce19df6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:08.662990 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-dc0d4f27-5983-4e5c-811c-abe98ce19df6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1677 microversion: 2.1 time: 0.282343 Dec 15 16:25:08.663630 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 289/592] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:08 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1677 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:09.631138 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-7949980c-3fc4-42f7-abec-374c7d224d50 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:25:09.632097 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-7949980c-3fc4-42f7-abec-374c7d224d50 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:09.639935 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7949980c-3fc4-42f7-abec-374c7d224d50 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:09.640677 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7949980c-3fc4-42f7-abec-374c7d224d50 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:09.641472 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7949980c-3fc4-42f7-abec-374c7d224d50 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:09.641895 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7949980c-3fc4-42f7-abec-374c7d224d50 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:09.681910 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-3baa0548-fb3a-49d1-8580-d3b7ebb255ea tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:09.682556 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-3baa0548-fb3a-49d1-8580-d3b7ebb255ea tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:09.690281 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3baa0548-fb3a-49d1-8580-d3b7ebb255ea tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:09.690831 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3baa0548-fb3a-49d1-8580-d3b7ebb255ea tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:09.691427 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3baa0548-fb3a-49d1-8580-d3b7ebb255ea tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:09.692073 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3baa0548-fb3a-49d1-8580-d3b7ebb255ea tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:09.731435 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-7949980c-3fc4-42f7-abec-374c7d224d50 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action" status: 200 len: 2071 microversion: 2.20 time: 0.104560 Dec 15 16:25:09.731435 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 304/593] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:25:09 2021] POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action => generated 2071 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:25:09.873426 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-3baa0548-fb3a-49d1-8580-d3b7ebb255ea tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:09.883111 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-3baa0548-fb3a-49d1-8580-d3b7ebb255ea tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1677 microversion: 2.1 time: 0.204665 Dec 15 16:25:09.883640 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 290/594] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:09 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1677 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:25:10.740657 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e776f6fb-c559-4e09-ba94-c54f5e605660 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:25:10.741797 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e776f6fb-c559-4e09-ba94-c54f5e605660 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:10.749330 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e776f6fb-c559-4e09-ba94-c54f5e605660 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:10.749818 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e776f6fb-c559-4e09-ba94-c54f5e605660 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:10.750616 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e776f6fb-c559-4e09-ba94-c54f5e605660 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:10.751199 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e776f6fb-c559-4e09-ba94-c54f5e605660 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:10.845545 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e776f6fb-c559-4e09-ba94-c54f5e605660 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action" status: 200 len: 10009 microversion: 2.20 time: 0.109360 Dec 15 16:25:10.846200 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 305/595] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:25:10 2021] POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action => generated 10009 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:25:10.901552 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-d28a7f5d-0934-4bec-b126-06c5d85b1785 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:10.902272 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-d28a7f5d-0934-4bec-b126-06c5d85b1785 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:10.912652 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d28a7f5d-0934-4bec-b126-06c5d85b1785 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:10.913099 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d28a7f5d-0934-4bec-b126-06c5d85b1785 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:10.913916 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d28a7f5d-0934-4bec-b126-06c5d85b1785 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:10.914393 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d28a7f5d-0934-4bec-b126-06c5d85b1785 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:11.080377 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-d28a7f5d-0934-4bec-b126-06c5d85b1785 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:11.089183 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-d28a7f5d-0934-4bec-b126-06c5d85b1785 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1677 microversion: 2.1 time: 0.191330 Dec 15 16:25:11.089836 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 291/596] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:10 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1677 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:11.858323 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-8376f82d-179d-409d-9439-8bcb53524196 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:25:11.859342 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-8376f82d-179d-409d-9439-8bcb53524196 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:11.868210 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8376f82d-179d-409d-9439-8bcb53524196 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:11.868818 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8376f82d-179d-409d-9439-8bcb53524196 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:11.869871 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8376f82d-179d-409d-9439-8bcb53524196 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:11.870652 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8376f82d-179d-409d-9439-8bcb53524196 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:11.963855 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-8376f82d-179d-409d-9439-8bcb53524196 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action" status: 200 len: 15895 microversion: 2.20 time: 0.109922 Dec 15 16:25:11.964545 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 306/597] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:25:11 2021] POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action => generated 15895 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:25:12.111455 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-72e07a29-b54b-428c-badf-772f49f179bc tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:12.112850 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-72e07a29-b54b-428c-badf-772f49f179bc tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:12.124888 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-72e07a29-b54b-428c-badf-772f49f179bc tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:12.125674 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-72e07a29-b54b-428c-badf-772f49f179bc tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:12.127323 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-72e07a29-b54b-428c-badf-772f49f179bc tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:12.128971 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-72e07a29-b54b-428c-badf-772f49f179bc tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:12.286625 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-72e07a29-b54b-428c-badf-772f49f179bc tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:12.294609 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-72e07a29-b54b-428c-badf-772f49f179bc tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1654 microversion: 2.1 time: 0.189040 Dec 15 16:25:12.295192 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 292/598] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:12 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1654 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:25:12.313243 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-2298ec54-3905-4336-863e-4f14944e77a1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:25:12.320955 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2298ec54-3905-4336-863e-4f14944e77a1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:12.321399 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2298ec54-3905-4336-863e-4f14944e77a1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:12.348564 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-2298ec54-3905-4336-863e-4f14944e77a1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Going to try to start instance {{(pid=116084) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 15 16:25:12.400085 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-2298ec54-3905-4336-863e-4f14944e77a1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action" status: 202 len: 0 microversion: 2.1 time: 0.090738 Dec 15 16:25:12.400715 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 307/599] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:25:12 2021] POST /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:25:12.410991 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-144ede47-8de7-406f-b71b-82057e829977 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:12.411744 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-144ede47-8de7-406f-b71b-82057e829977 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:12.418451 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-144ede47-8de7-406f-b71b-82057e829977 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:12.419243 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-144ede47-8de7-406f-b71b-82057e829977 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:12.420362 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-144ede47-8de7-406f-b71b-82057e829977 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:12.420864 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-144ede47-8de7-406f-b71b-82057e829977 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:12.582583 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-144ede47-8de7-406f-b71b-82057e829977 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:12.592771 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-144ede47-8de7-406f-b71b-82057e829977 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1663 microversion: 2.1 time: 0.186373 Dec 15 16:25:12.593667 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 293/600] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:12 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1663 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:12.979732 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f7617d1e-9a32-4d53-9a52-61d1f97cc29d tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:25:12.980864 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f7617d1e-9a32-4d53-9a52-61d1f97cc29d tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:12.987504 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f7617d1e-9a32-4d53-9a52-61d1f97cc29d tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:12.987962 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f7617d1e-9a32-4d53-9a52-61d1f97cc29d tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:12.988776 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f7617d1e-9a32-4d53-9a52-61d1f97cc29d tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:12.989221 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f7617d1e-9a32-4d53-9a52-61d1f97cc29d tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:13.078053 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f7617d1e-9a32-4d53-9a52-61d1f97cc29d tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action" status: 200 len: 18356 microversion: 2.20 time: 0.103669 Dec 15 16:25:13.079029 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 308/601] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:25:12 2021] POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action => generated 18356 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:25:13.611559 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-b38ce6c5-e76d-4be2-b72e-c1f42e6338ab tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:13.613513 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-b38ce6c5-e76d-4be2-b72e-c1f42e6338ab tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:13.629311 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b38ce6c5-e76d-4be2-b72e-c1f42e6338ab tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:13.630693 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b38ce6c5-e76d-4be2-b72e-c1f42e6338ab tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:13.631885 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b38ce6c5-e76d-4be2-b72e-c1f42e6338ab tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:13.632555 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b38ce6c5-e76d-4be2-b72e-c1f42e6338ab tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:13.817371 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-b38ce6c5-e76d-4be2-b72e-c1f42e6338ab tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:13.828105 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-b38ce6c5-e76d-4be2-b72e-c1f42e6338ab tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1663 microversion: 2.1 time: 0.220360 Dec 15 16:25:13.828718 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 294/602] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:13 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1663 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:14.094274 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1ab516b4-91e3-4a1d-a7ac-7dcf86d6ef4a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:25:14.098601 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1ab516b4-91e3-4a1d-a7ac-7dcf86d6ef4a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:14.107429 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1ab516b4-91e3-4a1d-a7ac-7dcf86d6ef4a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:14.108230 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1ab516b4-91e3-4a1d-a7ac-7dcf86d6ef4a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:14.109696 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1ab516b4-91e3-4a1d-a7ac-7dcf86d6ef4a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:14.110497 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1ab516b4-91e3-4a1d-a7ac-7dcf86d6ef4a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:14.847219 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-80972395-fc8c-4e01-b31d-e1d4f49af378 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:14.847894 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-80972395-fc8c-4e01-b31d-e1d4f49af378 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:14.855357 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-80972395-fc8c-4e01-b31d-e1d4f49af378 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:14.855846 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-80972395-fc8c-4e01-b31d-e1d4f49af378 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:14.856653 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-80972395-fc8c-4e01-b31d-e1d4f49af378 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:14.857089 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-80972395-fc8c-4e01-b31d-e1d4f49af378 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:15.023521 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-80972395-fc8c-4e01-b31d-e1d4f49af378 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:15.032688 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-80972395-fc8c-4e01-b31d-e1d4f49af378 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1667 microversion: 2.1 time: 0.189791 Dec 15 16:25:15.033411 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 295/603] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:14 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1667 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:16.724849 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1ab516b4-91e3-4a1d-a7ac-7dcf86d6ef4a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action" status: 200 len: 23223 microversion: 2.20 time: 2.636669 Dec 15 16:25:16.725661 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 309/604] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:25:14 2021] POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action => generated 23223 bytes in 2639 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:25:17.738923 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-0b9fcc23-eefb-4bf9-a89b-83015a6ae0e2 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:25:17.740068 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-0b9fcc23-eefb-4bf9-a89b-83015a6ae0e2 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:17.748201 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0b9fcc23-eefb-4bf9-a89b-83015a6ae0e2 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:17.748946 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0b9fcc23-eefb-4bf9-a89b-83015a6ae0e2 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:17.750111 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0b9fcc23-eefb-4bf9-a89b-83015a6ae0e2 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:17.750879 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0b9fcc23-eefb-4bf9-a89b-83015a6ae0e2 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:17.841449 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-0b9fcc23-eefb-4bf9-a89b-83015a6ae0e2 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action" status: 200 len: 24373 microversion: 2.20 time: 0.106417 Dec 15 16:25:17.841995 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 296/605] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:25:17 2021] POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action => generated 24373 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:25:18.855792 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-4ad71689-4df3-404d-babb-5bc794faf932 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:25:18.856877 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-4ad71689-4df3-404d-babb-5bc794faf932 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:18.866113 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4ad71689-4df3-404d-babb-5bc794faf932 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:18.866558 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4ad71689-4df3-404d-babb-5bc794faf932 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:18.867362 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4ad71689-4df3-404d-babb-5bc794faf932 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:18.867816 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4ad71689-4df3-404d-babb-5bc794faf932 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:18.967459 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-4ad71689-4df3-404d-babb-5bc794faf932 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action" status: 200 len: 25661 microversion: 2.20 time: 0.116142 Dec 15 16:25:18.968848 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 310/606] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:25:18 2021] POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action => generated 25661 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:25:19.980819 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-712dc60c-c001-4dbb-8c19-1679a3776d8f tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:25:19.981737 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-712dc60c-c001-4dbb-8c19-1679a3776d8f tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:19.989540 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-712dc60c-c001-4dbb-8c19-1679a3776d8f tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:19.989975 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-712dc60c-c001-4dbb-8c19-1679a3776d8f tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:19.990910 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-712dc60c-c001-4dbb-8c19-1679a3776d8f tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:19.991414 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-712dc60c-c001-4dbb-8c19-1679a3776d8f tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:20.093593 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-712dc60c-c001-4dbb-8c19-1679a3776d8f tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action" status: 200 len: 26462 microversion: 2.20 time: 0.117475 Dec 15 16:25:20.094312 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 297/607] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:25:19 2021] POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action => generated 26462 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:25:21.111682 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0784329f-12b9-42fd-9881-cb489659e990 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:25:21.113022 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-0784329f-12b9-42fd-9881-cb489659e990 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:21.124497 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0784329f-12b9-42fd-9881-cb489659e990 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:21.125154 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0784329f-12b9-42fd-9881-cb489659e990 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:21.126149 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0784329f-12b9-42fd-9881-cb489659e990 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:21.126575 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0784329f-12b9-42fd-9881-cb489659e990 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:21.236906 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0784329f-12b9-42fd-9881-cb489659e990 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action" status: 200 len: 27229 microversion: 2.20 time: 0.133587 Dec 15 16:25:21.237660 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 311/608] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:25:21 2021] POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action => generated 27229 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:25:22.256360 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-de5c779e-0fdc-4518-8d20-95f9f5508168 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:25:22.257714 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-de5c779e-0fdc-4518-8d20-95f9f5508168 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:22.269418 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-de5c779e-0fdc-4518-8d20-95f9f5508168 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:22.269875 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-de5c779e-0fdc-4518-8d20-95f9f5508168 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:22.270700 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-de5c779e-0fdc-4518-8d20-95f9f5508168 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:22.271110 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-de5c779e-0fdc-4518-8d20-95f9f5508168 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:22.385230 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-de5c779e-0fdc-4518-8d20-95f9f5508168 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action" status: 200 len: 27945 microversion: 2.20 time: 0.135888 Dec 15 16:25:22.385898 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 298/609] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:25:22 2021] POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action => generated 27945 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:25:23.269060 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-cf08c76e-62d9-4a36-a869-acf0774e6fee tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b60fb5bf-116a-4476-80c6-edb4ede93394", "device": "/dev/sdb"}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:25:23.271086 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-cf08c76e-62d9-4a36-a869-acf0774e6fee tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] [instance: 4b73cd2e-45d9-4808-a4d4-db5836234372] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:23.279444 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cf08c76e-62d9-4a36-a869-acf0774e6fee tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:23.279957 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cf08c76e-62d9-4a36-a869-acf0774e6fee tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:23.280830 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cf08c76e-62d9-4a36-a869-acf0774e6fee tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:23.281304 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cf08c76e-62d9-4a36-a869-acf0774e6fee tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:23.398979 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-ededbeb7-6727-4604-8b1e-5238b99f5c41 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:25:23.400057 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-ededbeb7-6727-4604-8b1e-5238b99f5c41 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:23.407672 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ededbeb7-6727-4604-8b1e-5238b99f5c41 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:23.408134 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ededbeb7-6727-4604-8b1e-5238b99f5c41 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:23.408944 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ededbeb7-6727-4604-8b1e-5238b99f5c41 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:23.409401 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ededbeb7-6727-4604-8b1e-5238b99f5c41 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:23.500122 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-ededbeb7-6727-4604-8b1e-5238b99f5c41 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action" status: 200 len: 28182 microversion: 2.20 time: 0.104732 Dec 15 16:25:23.501958 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 299/610] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:25:23 2021] POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action => generated 28182 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:25:23.594123 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-cf08c76e-62d9-4a36-a869-acf0774e6fee tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] 10.222.0.60 "POST /compute/v2.1/servers/4b73cd2e-45d9-4808-a4d4-db5836234372/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.329465 Dec 15 16:25:23.595186 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 312/611] 10.222.0.60 () {60 vars in 1322 bytes} [Wed Dec 15 16:25:23 2021] POST /compute/v2.1/servers/4b73cd2e-45d9-4808-a4d4-db5836234372/os-volume_attachments => generated 194 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:25:24.517554 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-9c3061fb-23ae-4da6-97dc-d2d2568f82c4 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:25:24.518729 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-9c3061fb-23ae-4da6-97dc-d2d2568f82c4 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:24.526756 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9c3061fb-23ae-4da6-97dc-d2d2568f82c4 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:24.527205 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9c3061fb-23ae-4da6-97dc-d2d2568f82c4 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:24.528049 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9c3061fb-23ae-4da6-97dc-d2d2568f82c4 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:24.528530 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9c3061fb-23ae-4da6-97dc-d2d2568f82c4 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:24.617544 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-9c3061fb-23ae-4da6-97dc-d2d2568f82c4 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action" status: 200 len: 28184 microversion: 2.20 time: 0.104024 Dec 15 16:25:24.618124 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 300/612] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:25:24 2021] POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action => generated 28184 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:25:25.634677 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-54434481-ae46-4e55-88c0-816196f89080 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:25:25.637069 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-54434481-ae46-4e55-88c0-816196f89080 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:25.648761 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-54434481-ae46-4e55-88c0-816196f89080 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:25.649476 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-54434481-ae46-4e55-88c0-816196f89080 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:25.650784 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-54434481-ae46-4e55-88c0-816196f89080 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:25.651457 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-54434481-ae46-4e55-88c0-816196f89080 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:25.750452 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-54434481-ae46-4e55-88c0-816196f89080 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action" status: 200 len: 28380 microversion: 2.20 time: 0.123379 Dec 15 16:25:25.751107 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 313/613] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:25:25 2021] POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action => generated 28380 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:25:26.763080 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-e1689aa3-ca18-47a7-a8e2-dd7a232ba036 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:25:26.764119 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-e1689aa3-ca18-47a7-a8e2-dd7a232ba036 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:26.771612 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e1689aa3-ca18-47a7-a8e2-dd7a232ba036 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:26.772056 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e1689aa3-ca18-47a7-a8e2-dd7a232ba036 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:26.772856 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e1689aa3-ca18-47a7-a8e2-dd7a232ba036 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:26.773282 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e1689aa3-ca18-47a7-a8e2-dd7a232ba036 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:26.855273 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-e1689aa3-ca18-47a7-a8e2-dd7a232ba036 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action" status: 200 len: 28491 microversion: 2.20 time: 0.095792 Dec 15 16:25:26.856484 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 301/614] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:25:26 2021] POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action => generated 28491 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:25:27.870163 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-16af95fe-2755-41d4-a8d3-549db74365ab tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:25:27.871186 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-16af95fe-2755-41d4-a8d3-549db74365ab tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:27.879301 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-16af95fe-2755-41d4-a8d3-549db74365ab tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:27.879797 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-16af95fe-2755-41d4-a8d3-549db74365ab tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:27.880622 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-16af95fe-2755-41d4-a8d3-549db74365ab tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:27.881067 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-16af95fe-2755-41d4-a8d3-549db74365ab tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:27.966074 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-16af95fe-2755-41d4-a8d3-549db74365ab tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action" status: 200 len: 28642 microversion: 2.20 time: 0.100118 Dec 15 16:25:27.966749 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 314/615] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:25:27 2021] POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action => generated 28642 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:25:28.982471 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-0e51d5c6-8859-43bc-9aaa-6706816c0aec tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:25:28.983867 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-0e51d5c6-8859-43bc-9aaa-6706816c0aec tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:28.995508 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0e51d5c6-8859-43bc-9aaa-6706816c0aec tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:28.996491 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0e51d5c6-8859-43bc-9aaa-6706816c0aec tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:28.997668 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0e51d5c6-8859-43bc-9aaa-6706816c0aec tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:28.998541 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0e51d5c6-8859-43bc-9aaa-6706816c0aec tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:29.097439 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-0e51d5c6-8859-43bc-9aaa-6706816c0aec tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action" status: 200 len: 28642 microversion: 2.20 time: 0.119464 Dec 15 16:25:29.098286 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 302/616] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:25:28 2021] POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action => generated 28642 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:25:30.114705 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c164a533-dc0f-4c54-bd98-468981025494 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:25:30.116523 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c164a533-dc0f-4c54-bd98-468981025494 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:30.129546 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c164a533-dc0f-4c54-bd98-468981025494 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:30.130323 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c164a533-dc0f-4c54-bd98-468981025494 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:30.131719 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c164a533-dc0f-4c54-bd98-468981025494 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:30.132458 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c164a533-dc0f-4c54-bd98-468981025494 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:30.231723 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c164a533-dc0f-4c54-bd98-468981025494 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action" status: 200 len: 28642 microversion: 2.20 time: 0.124793 Dec 15 16:25:30.232430 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 315/617] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:25:30 2021] POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action => generated 28642 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:25:31.245664 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-35ea5fb9-e374-4adc-b123-1bf39a417a64 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:25:31.247409 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-35ea5fb9-e374-4adc-b123-1bf39a417a64 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:31.256071 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-35ea5fb9-e374-4adc-b123-1bf39a417a64 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:31.256641 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-35ea5fb9-e374-4adc-b123-1bf39a417a64 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:31.257528 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-35ea5fb9-e374-4adc-b123-1bf39a417a64 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:31.258030 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-35ea5fb9-e374-4adc-b123-1bf39a417a64 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:31.348789 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-35ea5fb9-e374-4adc-b123-1bf39a417a64 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action" status: 200 len: 28667 microversion: 2.20 time: 0.107173 Dec 15 16:25:31.351499 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 303/618] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:25:31 2021] POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action => generated 28667 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:25:32.362717 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e648b5ab-bd88-40ad-8c59-b5dd666f8c1f tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:25:32.363768 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e648b5ab-bd88-40ad-8c59-b5dd666f8c1f tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:32.371907 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e648b5ab-bd88-40ad-8c59-b5dd666f8c1f tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:32.372359 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e648b5ab-bd88-40ad-8c59-b5dd666f8c1f tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:32.373230 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e648b5ab-bd88-40ad-8c59-b5dd666f8c1f tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:32.373666 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e648b5ab-bd88-40ad-8c59-b5dd666f8c1f tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:34.504098 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e648b5ab-bd88-40ad-8c59-b5dd666f8c1f tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action" status: 200 len: 33386 microversion: 2.20 time: 2.145120 Dec 15 16:25:34.504974 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 316/619] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:25:32 2021] POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action => generated 33386 bytes in 2147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:25:35.517655 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-013f8fb8-c694-4bec-9fdf-0dcf2f7e38da tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:25:35.518975 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-013f8fb8-c694-4bec-9fdf-0dcf2f7e38da tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:35.526733 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-013f8fb8-c694-4bec-9fdf-0dcf2f7e38da tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:35.527181 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-013f8fb8-c694-4bec-9fdf-0dcf2f7e38da tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:35.527997 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-013f8fb8-c694-4bec-9fdf-0dcf2f7e38da tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:35.528455 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-013f8fb8-c694-4bec-9fdf-0dcf2f7e38da tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:37.749778 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-013f8fb8-c694-4bec-9fdf-0dcf2f7e38da tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action" status: 200 len: 36907 microversion: 2.20 time: 2.236071 Dec 15 16:25:37.750479 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 304/620] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:25:35 2021] POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action => generated 36907 bytes in 2238 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:25:38.767639 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1afccb44-9a34-4e96-bdae-68319ca34223 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:25:38.769338 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1afccb44-9a34-4e96-bdae-68319ca34223 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:38.778819 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1afccb44-9a34-4e96-bdae-68319ca34223 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:38.779278 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1afccb44-9a34-4e96-bdae-68319ca34223 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:38.780115 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1afccb44-9a34-4e96-bdae-68319ca34223 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:38.780549 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1afccb44-9a34-4e96-bdae-68319ca34223 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:40.976444 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1afccb44-9a34-4e96-bdae-68319ca34223 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action" status: 200 len: 38193 microversion: 2.20 time: 2.216281 Dec 15 16:25:40.977553 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 317/621] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:25:38 2021] POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action => generated 38193 bytes in 2219 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:25:41.989860 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-f84f6ee2-d6a9-42ef-84d6-d1051c769a4c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:25:41.990880 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-f84f6ee2-d6a9-42ef-84d6-d1051c769a4c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:41.999982 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f84f6ee2-d6a9-42ef-84d6-d1051c769a4c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:42.000855 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f84f6ee2-d6a9-42ef-84d6-d1051c769a4c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:42.001561 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f84f6ee2-d6a9-42ef-84d6-d1051c769a4c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:42.002001 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f84f6ee2-d6a9-42ef-84d6-d1051c769a4c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:44.172282 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-f84f6ee2-d6a9-42ef-84d6-d1051c769a4c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action" status: 200 len: 38334 microversion: 2.20 time: 2.186332 Dec 15 16:25:44.172981 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 305/622] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:25:41 2021] POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action => generated 38334 bytes in 2188 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:25:44.185005 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-09a42733-476b-4772-ad7e-54ec122c021d tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:44.185561 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-09a42733-476b-4772-ad7e-54ec122c021d tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:44.196170 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-09a42733-476b-4772-ad7e-54ec122c021d tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:44.196623 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-09a42733-476b-4772-ad7e-54ec122c021d tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:44.197423 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-09a42733-476b-4772-ad7e-54ec122c021d tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:44.198635 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-09a42733-476b-4772-ad7e-54ec122c021d tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:44.225867 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-09a42733-476b-4772-ad7e-54ec122c021d tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/ips" status: 200 len: 152 microversion: 2.20 time: 0.045878 Dec 15 16:25:44.226358 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 318/623] 10.222.0.60 () {60 vars in 1288 bytes} [Wed Dec 15 16:25:44 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/ips => generated 152 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:25:48.933392 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-49928b49-1455-4d35-977e-10b1db72d4df tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:25:48.934102 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-49928b49-1455-4d35-977e-10b1db72d4df tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:48.942114 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-49928b49-1455-4d35-977e-10b1db72d4df tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:48.942550 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-49928b49-1455-4d35-977e-10b1db72d4df tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:48.943346 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-49928b49-1455-4d35-977e-10b1db72d4df tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:48.943838 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-49928b49-1455-4d35-977e-10b1db72d4df tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:48.968917 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.objects.instance [None req-49928b49-1455-4d35-977e-10b1db72d4df tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lazy-loading 'flavor' on Instance uuid 049761b5-88eb-4325-af0e-03da2842cbf5 {{(pid=116085) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:25:49.258694 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-49928b49-1455-4d35-977e-10b1db72d4df tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action" status: 202 len: 0 microversion: 2.20 time: 0.330521 Dec 15 16:25:49.259602 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 306/624] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:25:48 2021] POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:25:49.268864 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-a62ad055-339f-4fcf-9578-a58d085d88dd tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:49.269489 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-a62ad055-339f-4fcf-9578-a58d085d88dd tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:49.276507 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a62ad055-339f-4fcf-9578-a58d085d88dd tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:49.277144 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a62ad055-339f-4fcf-9578-a58d085d88dd tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:49.277960 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a62ad055-339f-4fcf-9578-a58d085d88dd tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:49.278408 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a62ad055-339f-4fcf-9578-a58d085d88dd tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:49.429394 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-a62ad055-339f-4fcf-9578-a58d085d88dd tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:49.438463 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-a62ad055-339f-4fcf-9578-a58d085d88dd tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:49.440156 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-a62ad055-339f-4fcf-9578-a58d085d88dd tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:49.441286 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-a62ad055-339f-4fcf-9578-a58d085d88dd tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1722 microversion: 2.20 time: 0.176953 Dec 15 16:25:49.442038 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 319/625] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:25:49 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:25:50.462505 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-8acfc690-a65b-4d96-bec3-4d4b28aaa157 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:50.463211 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-8acfc690-a65b-4d96-bec3-4d4b28aaa157 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:50.470669 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8acfc690-a65b-4d96-bec3-4d4b28aaa157 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:50.471123 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8acfc690-a65b-4d96-bec3-4d4b28aaa157 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:50.471987 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8acfc690-a65b-4d96-bec3-4d4b28aaa157 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:50.472419 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8acfc690-a65b-4d96-bec3-4d4b28aaa157 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:50.627126 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-8acfc690-a65b-4d96-bec3-4d4b28aaa157 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:50.639167 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-8acfc690-a65b-4d96-bec3-4d4b28aaa157 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:50.640893 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-8acfc690-a65b-4d96-bec3-4d4b28aaa157 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:50.642107 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-8acfc690-a65b-4d96-bec3-4d4b28aaa157 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1722 microversion: 2.20 time: 0.184478 Dec 15 16:25:50.642689 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 307/626] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:25:50 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:25:51.651030 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-19a70a0d-02bd-4837-95a7-92cfe41c3c81 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:51.651643 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-19a70a0d-02bd-4837-95a7-92cfe41c3c81 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] [instance: 4b73cd2e-45d9-4808-a4d4-db5836234372] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:51.658884 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-19a70a0d-02bd-4837-95a7-92cfe41c3c81 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:51.659390 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-19a70a0d-02bd-4837-95a7-92cfe41c3c81 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:51.660187 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-19a70a0d-02bd-4837-95a7-92cfe41c3c81 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:51.660673 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-19a70a0d-02bd-4837-95a7-92cfe41c3c81 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:51.662733 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-791dc599-92ae-4d86-af49-30f372e91151 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:51.663560 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-791dc599-92ae-4d86-af49-30f372e91151 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:51.673233 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-791dc599-92ae-4d86-af49-30f372e91151 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:51.673875 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-791dc599-92ae-4d86-af49-30f372e91151 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:51.674861 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-791dc599-92ae-4d86-af49-30f372e91151 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:51.675681 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-791dc599-92ae-4d86-af49-30f372e91151 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:51.776593 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.objects.instance [None req-19a70a0d-02bd-4837-95a7-92cfe41c3c81 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lazy-loading 'services' on Instance uuid 4b73cd2e-45d9-4808-a4d4-db5836234372 {{(pid=116084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:25:51.837482 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-791dc599-92ae-4d86-af49-30f372e91151 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:51.846102 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-791dc599-92ae-4d86-af49-30f372e91151 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:51.847786 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-791dc599-92ae-4d86-af49-30f372e91151 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:51.848961 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-791dc599-92ae-4d86-af49-30f372e91151 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1722 microversion: 2.20 time: 0.190593 Dec 15 16:25:51.849526 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 308/627] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:25:51 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:25:51.851992 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-19a70a0d-02bd-4837-95a7-92cfe41c3c81 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4b73cd2e-45d9-4808-a4d4-db5836234372/os-volume_attachments/b60fb5bf-116a-4476-80c6-edb4ede93394" status: 202 len: 0 microversion: 2.1 time: 0.204535 Dec 15 16:25:51.852616 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 320/628] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Dec 15 16:25:51 2021] DELETE /compute/v2.1/servers/4b73cd2e-45d9-4808-a4d4-db5836234372/os-volume_attachments/b60fb5bf-116a-4476-80c6-edb4ede93394 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:25:52.869815 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-307157f1-b445-4a82-ba93-dfd8557c9081 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:52.870822 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-307157f1-b445-4a82-ba93-dfd8557c9081 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:52.878419 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-307157f1-b445-4a82-ba93-dfd8557c9081 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:52.879000 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-307157f1-b445-4a82-ba93-dfd8557c9081 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:52.880020 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-307157f1-b445-4a82-ba93-dfd8557c9081 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:52.880459 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-307157f1-b445-4a82-ba93-dfd8557c9081 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:52.994682 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-2669c122-17af-4cfb-9360-24400c971903 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:52.995603 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-2669c122-17af-4cfb-9360-24400c971903 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] [instance: 4b73cd2e-45d9-4808-a4d4-db5836234372] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:53.002026 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2669c122-17af-4cfb-9360-24400c971903 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:53.002470 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2669c122-17af-4cfb-9360-24400c971903 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:53.003250 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2669c122-17af-4cfb-9360-24400c971903 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:53.003719 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2669c122-17af-4cfb-9360-24400c971903 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:53.024808 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-307157f1-b445-4a82-ba93-dfd8557c9081 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:53.028731 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-2669c122-17af-4cfb-9360-24400c971903 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] [instance: 4b73cd2e-45d9-4808-a4d4-db5836234372] Going to try to terminate instance {{(pid=116084) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:25:53.034048 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-307157f1-b445-4a82-ba93-dfd8557c9081 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:53.035575 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-307157f1-b445-4a82-ba93-dfd8557c9081 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:53.036738 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-307157f1-b445-4a82-ba93-dfd8557c9081 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1722 microversion: 2.20 time: 0.172130 Dec 15 16:25:53.037305 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 309/629] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:25:52 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:25:53.114352 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-2669c122-17af-4cfb-9360-24400c971903 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4b73cd2e-45d9-4808-a4d4-db5836234372" status: 204 len: 0 microversion: 2.1 time: 0.123961 Dec 15 16:25:53.114953 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 321/630] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Dec 15 16:25:52 2021] DELETE /compute/v2.1/servers/4b73cd2e-45d9-4808-a4d4-db5836234372 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:25:53.123682 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-3f995aef-af38-44ad-ac53-b1ce877a4cdf tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:53.124309 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-3f995aef-af38-44ad-ac53-b1ce877a4cdf tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] [instance: 4b73cd2e-45d9-4808-a4d4-db5836234372] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:53.130713 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3f995aef-af38-44ad-ac53-b1ce877a4cdf tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:53.131073 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3f995aef-af38-44ad-ac53-b1ce877a4cdf tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:53.131887 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3f995aef-af38-44ad-ac53-b1ce877a4cdf tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:53.132307 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3f995aef-af38-44ad-ac53-b1ce877a4cdf tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:53.279400 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-3f995aef-af38-44ad-ac53-b1ce877a4cdf tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b8a0a1adc54ff4abafe90692d10543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f435a136a5e44f89a0b09d4ec7427b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:53.287721 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-3f995aef-af38-44ad-ac53-b1ce877a4cdf tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] 10.222.0.60 "GET /compute/v2.1/servers/4b73cd2e-45d9-4808-a4d4-db5836234372" status: 200 len: 1513 microversion: 2.1 time: 0.168047 Dec 15 16:25:53.288398 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 310/631] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:53 2021] GET /compute/v2.1/servers/4b73cd2e-45d9-4808-a4d4-db5836234372 => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:54.057100 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0a601c68-5392-422c-ba61-a17b2b64043b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:54.057771 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-0a601c68-5392-422c-ba61-a17b2b64043b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:54.064652 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0a601c68-5392-422c-ba61-a17b2b64043b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:54.065107 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0a601c68-5392-422c-ba61-a17b2b64043b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:54.065889 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0a601c68-5392-422c-ba61-a17b2b64043b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:54.066320 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0a601c68-5392-422c-ba61-a17b2b64043b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:54.211820 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-0a601c68-5392-422c-ba61-a17b2b64043b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:54.220900 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-0a601c68-5392-422c-ba61-a17b2b64043b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:54.222395 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-0a601c68-5392-422c-ba61-a17b2b64043b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:54.223728 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0a601c68-5392-422c-ba61-a17b2b64043b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1722 microversion: 2.20 time: 0.170688 Dec 15 16:25:54.224521 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 322/632] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:25:54 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:25:54.305772 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-21b4d1c2-a6f9-48d9-9146-47b77b76daa0 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:54.306471 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-21b4d1c2-a6f9-48d9-9146-47b77b76daa0 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] [instance: 4b73cd2e-45d9-4808-a4d4-db5836234372] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:54.313444 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-21b4d1c2-a6f9-48d9-9146-47b77b76daa0 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:54.313974 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-21b4d1c2-a6f9-48d9-9146-47b77b76daa0 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:54.314828 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-21b4d1c2-a6f9-48d9-9146-47b77b76daa0 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:54.315333 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-21b4d1c2-a6f9-48d9-9146-47b77b76daa0 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:54.450702 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-21b4d1c2-a6f9-48d9-9146-47b77b76daa0 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b8a0a1adc54ff4abafe90692d10543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f435a136a5e44f89a0b09d4ec7427b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:54.459956 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-21b4d1c2-a6f9-48d9-9146-47b77b76daa0 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] 10.222.0.60 "GET /compute/v2.1/servers/4b73cd2e-45d9-4808-a4d4-db5836234372" status: 200 len: 1513 microversion: 2.1 time: 0.157786 Dec 15 16:25:54.460543 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 311/633] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:54 2021] GET /compute/v2.1/servers/4b73cd2e-45d9-4808-a4d4-db5836234372 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:55.245447 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0fb9ec35-1759-414a-aa1c-ddeb9f4d81f8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:55.246154 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-0fb9ec35-1759-414a-aa1c-ddeb9f4d81f8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:55.253176 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0fb9ec35-1759-414a-aa1c-ddeb9f4d81f8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:55.253625 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0fb9ec35-1759-414a-aa1c-ddeb9f4d81f8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:55.254423 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0fb9ec35-1759-414a-aa1c-ddeb9f4d81f8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:55.254860 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0fb9ec35-1759-414a-aa1c-ddeb9f4d81f8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:55.407390 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-0fb9ec35-1759-414a-aa1c-ddeb9f4d81f8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:55.419421 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-0fb9ec35-1759-414a-aa1c-ddeb9f4d81f8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:55.420941 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-0fb9ec35-1759-414a-aa1c-ddeb9f4d81f8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:55.422118 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0fb9ec35-1759-414a-aa1c-ddeb9f4d81f8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1722 microversion: 2.20 time: 0.180793 Dec 15 16:25:55.422691 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 323/634] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:25:55 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:25:55.479038 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-99dfbabc-8f3f-4d41-bae0-e1fd0fb41cea tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:55.480045 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-99dfbabc-8f3f-4d41-bae0-e1fd0fb41cea tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] [instance: 4b73cd2e-45d9-4808-a4d4-db5836234372] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:55.487527 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-99dfbabc-8f3f-4d41-bae0-e1fd0fb41cea tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:55.487972 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-99dfbabc-8f3f-4d41-bae0-e1fd0fb41cea tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:55.488793 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-99dfbabc-8f3f-4d41-bae0-e1fd0fb41cea tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:55.489221 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-99dfbabc-8f3f-4d41-bae0-e1fd0fb41cea tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:55.633324 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-99dfbabc-8f3f-4d41-bae0-e1fd0fb41cea tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b8a0a1adc54ff4abafe90692d10543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f435a136a5e44f89a0b09d4ec7427b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:55.641684 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-99dfbabc-8f3f-4d41-bae0-e1fd0fb41cea tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] 10.222.0.60 "GET /compute/v2.1/servers/4b73cd2e-45d9-4808-a4d4-db5836234372" status: 200 len: 1513 microversion: 2.1 time: 0.166838 Dec 15 16:25:55.642260 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 312/635] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:55 2021] GET /compute/v2.1/servers/4b73cd2e-45d9-4808-a4d4-db5836234372 => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:56.441058 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-5b9b383a-2e48-4a1d-b1c3-ebe325ebec41 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:56.441664 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-5b9b383a-2e48-4a1d-b1c3-ebe325ebec41 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:56.449130 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5b9b383a-2e48-4a1d-b1c3-ebe325ebec41 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:56.449605 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5b9b383a-2e48-4a1d-b1c3-ebe325ebec41 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:56.450426 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5b9b383a-2e48-4a1d-b1c3-ebe325ebec41 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:56.450896 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5b9b383a-2e48-4a1d-b1c3-ebe325ebec41 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:56.593322 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-5b9b383a-2e48-4a1d-b1c3-ebe325ebec41 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:56.601569 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-5b9b383a-2e48-4a1d-b1c3-ebe325ebec41 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:56.603098 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-5b9b383a-2e48-4a1d-b1c3-ebe325ebec41 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:56.604596 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-5b9b383a-2e48-4a1d-b1c3-ebe325ebec41 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1722 microversion: 2.20 time: 0.167634 Dec 15 16:25:56.605848 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 324/636] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:25:56 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:25:56.659665 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-4d2369b1-3239-4b16-b8b3-a3fbda5d2d3e tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:56.660333 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-4d2369b1-3239-4b16-b8b3-a3fbda5d2d3e tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] [instance: 4b73cd2e-45d9-4808-a4d4-db5836234372] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:56.667872 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4d2369b1-3239-4b16-b8b3-a3fbda5d2d3e tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:56.668395 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4d2369b1-3239-4b16-b8b3-a3fbda5d2d3e tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:56.669283 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4d2369b1-3239-4b16-b8b3-a3fbda5d2d3e tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:56.669805 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4d2369b1-3239-4b16-b8b3-a3fbda5d2d3e tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:56.818003 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-4d2369b1-3239-4b16-b8b3-a3fbda5d2d3e tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b8a0a1adc54ff4abafe90692d10543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f435a136a5e44f89a0b09d4ec7427b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:56.825767 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-4d2369b1-3239-4b16-b8b3-a3fbda5d2d3e tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] 10.222.0.60 "GET /compute/v2.1/servers/4b73cd2e-45d9-4808-a4d4-db5836234372" status: 200 len: 1513 microversion: 2.1 time: 0.170100 Dec 15 16:25:56.826370 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 313/637] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:56 2021] GET /compute/v2.1/servers/4b73cd2e-45d9-4808-a4d4-db5836234372 => generated 1513 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:25:56.936304 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-e9bb4eb8-6b27-4d62-907b-c681592f1078 req-90847ea5-26a9-41e4-99a0-46f30efc7eef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b73cd2e-45d9-4808-a4d4-db5836234372", "name": "network-vif-deleted", "tag": "ad8b774e-9bea-4fa1-8869-54c2ac4331f0"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:25:56.937977 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:25:56.937977 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:25:56.947831 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-e9bb4eb8-6b27-4d62-907b-c681592f1078 req-90847ea5-26a9-41e4-99a0-46f30efc7eef service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:56.948177 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-e9bb4eb8-6b27-4d62-907b-c681592f1078 req-90847ea5-26a9-41e4-99a0-46f30efc7eef service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:56.960917 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-e9bb4eb8-6b27-4d62-907b-c681592f1078 req-90847ea5-26a9-41e4-99a0-46f30efc7eef service nova] Creating event network-vif-deleted:ad8b774e-9bea-4fa1-8869-54c2ac4331f0 for instance 4b73cd2e-45d9-4808-a4d4-db5836234372 on hv-cinder-81268 Dec 15 16:25:56.966456 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-e9bb4eb8-6b27-4d62-907b-c681592f1078 req-90847ea5-26a9-41e4-99a0-46f30efc7eef service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033900 Dec 15 16:25:56.967312 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 325/638] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:25:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:25:57.623798 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-49497cba-5b6d-46bd-9841-513ea86ecdf8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:57.624273 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-49497cba-5b6d-46bd-9841-513ea86ecdf8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:57.631761 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-49497cba-5b6d-46bd-9841-513ea86ecdf8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:57.632208 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-49497cba-5b6d-46bd-9841-513ea86ecdf8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:57.633008 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-49497cba-5b6d-46bd-9841-513ea86ecdf8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:57.633438 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-49497cba-5b6d-46bd-9841-513ea86ecdf8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:57.774931 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-49497cba-5b6d-46bd-9841-513ea86ecdf8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:57.783605 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-49497cba-5b6d-46bd-9841-513ea86ecdf8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:57.785118 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-49497cba-5b6d-46bd-9841-513ea86ecdf8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:57.786285 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-49497cba-5b6d-46bd-9841-513ea86ecdf8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1722 microversion: 2.20 time: 0.166713 Dec 15 16:25:57.786874 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 314/639] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:25:57 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:25:57.844871 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d0b48600-c0a2-495e-a0a8-b77ad2cb3195 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:57.845522 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d0b48600-c0a2-495e-a0a8-b77ad2cb3195 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] [instance: 4b73cd2e-45d9-4808-a4d4-db5836234372] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:57.852602 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d0b48600-c0a2-495e-a0a8-b77ad2cb3195 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:57.853086 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d0b48600-c0a2-495e-a0a8-b77ad2cb3195 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:57.853880 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d0b48600-c0a2-495e-a0a8-b77ad2cb3195 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:57.854314 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d0b48600-c0a2-495e-a0a8-b77ad2cb3195 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:57.869601 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-d0b48600-c0a2-495e-a0a8-b77ad2cb3195 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] HTTP exception thrown: Instance 4b73cd2e-45d9-4808-a4d4-db5836234372 could not be found. Dec 15 16:25:57.870752 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d0b48600-c0a2-495e-a0a8-b77ad2cb3195 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Returning 404 to user: Instance 4b73cd2e-45d9-4808-a4d4-db5836234372 could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:25:57.871679 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d0b48600-c0a2-495e-a0a8-b77ad2cb3195 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] 10.222.0.60 "GET /compute/v2.1/servers/4b73cd2e-45d9-4808-a4d4-db5836234372" status: 404 len: 111 microversion: 2.1 time: 0.031407 Dec 15 16:25:57.872248 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 326/640] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:25:57 2021] GET /compute/v2.1/servers/4b73cd2e-45d9-4808-a4d4-db5836234372 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:25:58.805792 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-6b861c16-d72d-4cbf-b395-57c14614dbc1 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:25:58.806396 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-6b861c16-d72d-4cbf-b395-57c14614dbc1 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:25:58.814143 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6b861c16-d72d-4cbf-b395-57c14614dbc1 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:58.814723 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6b861c16-d72d-4cbf-b395-57c14614dbc1 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:58.815532 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6b861c16-d72d-4cbf-b395-57c14614dbc1 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:25:58.815988 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6b861c16-d72d-4cbf-b395-57c14614dbc1 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:25:59.132382 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-6b861c16-d72d-4cbf-b395-57c14614dbc1 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:59.141100 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-6b861c16-d72d-4cbf-b395-57c14614dbc1 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:59.142627 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-6b861c16-d72d-4cbf-b395-57c14614dbc1 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:25:59.143826 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-6b861c16-d72d-4cbf-b395-57c14614dbc1 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1722 microversion: 2.20 time: 0.341880 Dec 15 16:25:59.144397 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 315/641] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:25:58 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1722 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:26:00.162692 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-60566666-7bde-4e4c-9d39-9db7d2e03e8a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:00.163286 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-60566666-7bde-4e4c-9d39-9db7d2e03e8a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:00.170419 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-60566666-7bde-4e4c-9d39-9db7d2e03e8a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:00.170871 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-60566666-7bde-4e4c-9d39-9db7d2e03e8a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:00.171683 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-60566666-7bde-4e4c-9d39-9db7d2e03e8a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:00.172126 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-60566666-7bde-4e4c-9d39-9db7d2e03e8a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:00.388958 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-60566666-7bde-4e4c-9d39-9db7d2e03e8a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:00.398557 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-60566666-7bde-4e4c-9d39-9db7d2e03e8a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:00.400066 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-60566666-7bde-4e4c-9d39-9db7d2e03e8a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:00.401229 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-60566666-7bde-4e4c-9d39-9db7d2e03e8a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1722 microversion: 2.20 time: 0.242389 Dec 15 16:26:00.401920 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 327/642] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:26:00 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:26:01.421810 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-139dc67c-b222-40c0-9c07-c03049d439ef tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:01.422393 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-139dc67c-b222-40c0-9c07-c03049d439ef tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:01.429137 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-139dc67c-b222-40c0-9c07-c03049d439ef tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:01.429597 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-139dc67c-b222-40c0-9c07-c03049d439ef tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:01.430387 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-139dc67c-b222-40c0-9c07-c03049d439ef tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:01.430822 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-139dc67c-b222-40c0-9c07-c03049d439ef tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:01.577665 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-139dc67c-b222-40c0-9c07-c03049d439ef tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:01.591435 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-139dc67c-b222-40c0-9c07-c03049d439ef tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:01.593987 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-139dc67c-b222-40c0-9c07-c03049d439ef tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:01.595907 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-139dc67c-b222-40c0-9c07-c03049d439ef tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1722 microversion: 2.20 time: 0.177820 Dec 15 16:26:01.596842 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 316/643] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:26:01 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:26:02.618609 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-4bb6a4e4-f506-4b1d-9fac-f4801d1a6038 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:02.619261 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-4bb6a4e4-f506-4b1d-9fac-f4801d1a6038 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:02.628175 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4bb6a4e4-f506-4b1d-9fac-f4801d1a6038 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:02.629078 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4bb6a4e4-f506-4b1d-9fac-f4801d1a6038 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:02.629961 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4bb6a4e4-f506-4b1d-9fac-f4801d1a6038 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:02.630405 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4bb6a4e4-f506-4b1d-9fac-f4801d1a6038 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:02.771269 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-4bb6a4e4-f506-4b1d-9fac-f4801d1a6038 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:02.780232 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-4bb6a4e4-f506-4b1d-9fac-f4801d1a6038 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:02.781725 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-4bb6a4e4-f506-4b1d-9fac-f4801d1a6038 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:02.782903 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-4bb6a4e4-f506-4b1d-9fac-f4801d1a6038 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1722 microversion: 2.20 time: 0.168381 Dec 15 16:26:02.783479 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 328/644] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:26:02 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:26:03.803691 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-78216ce8-f6de-4499-befe-93a9d44aa383 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:03.804304 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-78216ce8-f6de-4499-befe-93a9d44aa383 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:03.819542 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-78216ce8-f6de-4499-befe-93a9d44aa383 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:03.819999 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-78216ce8-f6de-4499-befe-93a9d44aa383 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:03.821053 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-78216ce8-f6de-4499-befe-93a9d44aa383 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:03.821540 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-78216ce8-f6de-4499-befe-93a9d44aa383 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:03.960388 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-78216ce8-f6de-4499-befe-93a9d44aa383 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:03.968420 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-78216ce8-f6de-4499-befe-93a9d44aa383 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:03.969923 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-78216ce8-f6de-4499-befe-93a9d44aa383 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:03.971091 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-78216ce8-f6de-4499-befe-93a9d44aa383 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1722 microversion: 2.20 time: 0.171570 Dec 15 16:26:03.971678 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 317/645] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:26:03 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:26:04.993804 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-167ad559-0917-406e-a01c-00dffe795793 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:04.994381 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-167ad559-0917-406e-a01c-00dffe795793 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:05.005497 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-167ad559-0917-406e-a01c-00dffe795793 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:05.005984 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-167ad559-0917-406e-a01c-00dffe795793 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:05.006739 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-167ad559-0917-406e-a01c-00dffe795793 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:05.007166 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-167ad559-0917-406e-a01c-00dffe795793 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:05.144790 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-167ad559-0917-406e-a01c-00dffe795793 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:05.153220 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-167ad559-0917-406e-a01c-00dffe795793 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:05.154959 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-167ad559-0917-406e-a01c-00dffe795793 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:05.156191 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-167ad559-0917-406e-a01c-00dffe795793 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1722 microversion: 2.20 time: 0.166354 Dec 15 16:26:05.156794 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 329/646] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:26:04 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:26:05.727300 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-2161a186-c97d-46ee-b9b9-24757b8d0e96 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1849309850", "imageRef": "b72b5f54-34d0-48ac-9484-bc8104a6dddb", "flavorRef": "452", "networks": [{"uuid": "57950f25-a0f8-46d5-8479-44bfafba8631"}]}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:26:05.780855 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.network.neutron [None req-2161a186-c97d-46ee-b9b9-24757b8d0e96 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] validate_networks() for [('57950f25-a0f8-46d5-8479-44bfafba8631', None, None, None, None, None)] {{(pid=116085) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:26:06.175503 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-469f2e62-697d-4ea6-a05f-69d0c97380be tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:06.176202 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-469f2e62-697d-4ea6-a05f-69d0c97380be tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:06.183072 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-469f2e62-697d-4ea6-a05f-69d0c97380be tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:06.183851 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-469f2e62-697d-4ea6-a05f-69d0c97380be tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:06.185585 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-469f2e62-697d-4ea6-a05f-69d0c97380be tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:06.186019 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-469f2e62-697d-4ea6-a05f-69d0c97380be tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:06.329777 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-2161a186-c97d-46ee-b9b9-24757b8d0e96 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Flavor limits 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:26:06.330195 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-2161a186-c97d-46ee-b9b9-24757b8d0e96 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Image limits 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:26:06.330678 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-2161a186-c97d-46ee-b9b9-24757b8d0e96 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Flavor pref 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:26:06.331085 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-2161a186-c97d-46ee-b9b9-24757b8d0e96 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Image pref 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:26:06.331522 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-2161a186-c97d-46ee-b9b9-24757b8d0e96 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:26:06.340246 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2161a186-c97d-46ee-b9b9-24757b8d0e96 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:06.340840 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2161a186-c97d-46ee-b9b9-24757b8d0e96 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:06.341970 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2161a186-c97d-46ee-b9b9-24757b8d0e96 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:06.342405 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2161a186-c97d-46ee-b9b9-24757b8d0e96 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:06.360556 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-2161a186-c97d-46ee-b9b9-24757b8d0e96 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Getting quotas for project 3f435a136a5e44f89a0b09d4ec7427b7. Resources: {'cores', 'instances', 'ram'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:26:06.365265 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-2161a186-c97d-46ee-b9b9-24757b8d0e96 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Getting quotas for user 39b8a0a1adc54ff4abafe90692d10543 and project 3f435a136a5e44f89a0b09d4ec7427b7. Resources: {'cores', 'instances', 'ram'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:26:06.376563 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-2161a186-c97d-46ee-b9b9-24757b8d0e96 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Going to run 1 instances... {{(pid=116085) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:26:06.378899 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-2161a186-c97d-46ee-b9b9-24757b8d0e96 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] [instance: b2c86622-4d3b-4750-9589-e485a89473cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b72b5f54-34d0-48ac-9484-bc8104a6dddb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116085) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:26:06.399987 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-469f2e62-697d-4ea6-a05f-69d0c97380be tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:06.410870 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-469f2e62-697d-4ea6-a05f-69d0c97380be tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:06.412462 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-469f2e62-697d-4ea6-a05f-69d0c97380be tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:06.413814 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-469f2e62-697d-4ea6-a05f-69d0c97380be tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1722 microversion: 2.20 time: 0.242022 Dec 15 16:26:06.414336 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 330/647] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:26:06 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1722 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:26:06.425274 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-2161a186-c97d-46ee-b9b9-24757b8d0e96 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.701771 Dec 15 16:26:06.426410 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 318/648] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Dec 15 16:26:05 2021] POST /compute/v2.1/servers => generated 380 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 16:26:06.440774 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0562ada0-8096-4e44-bb60-c3cbaadc6ecc tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:06.441382 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-0562ada0-8096-4e44-bb60-c3cbaadc6ecc tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] [instance: b2c86622-4d3b-4750-9589-e485a89473cb] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:06.512045 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-0562ada0-8096-4e44-bb60-c3cbaadc6ecc tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b8a0a1adc54ff4abafe90692d10543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f435a136a5e44f89a0b09d4ec7427b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:06.521356 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0562ada0-8096-4e44-bb60-c3cbaadc6ecc tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] 10.222.0.60 "GET /compute/v2.1/servers/b2c86622-4d3b-4750-9589-e485a89473cb" status: 200 len: 1219 microversion: 2.1 time: 0.084111 Dec 15 16:26:06.531297 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 331/649] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:06 2021] GET /compute/v2.1/servers/b2c86622-4d3b-4750-9589-e485a89473cb => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:07.432962 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-fe7102a9-419d-49ed-bd60-b04567a82bc4 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:07.433540 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-fe7102a9-419d-49ed-bd60-b04567a82bc4 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:07.440054 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fe7102a9-419d-49ed-bd60-b04567a82bc4 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:07.440792 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fe7102a9-419d-49ed-bd60-b04567a82bc4 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:07.441612 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fe7102a9-419d-49ed-bd60-b04567a82bc4 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:07.442058 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fe7102a9-419d-49ed-bd60-b04567a82bc4 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:07.538033 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-a827f7e0-ff4a-4485-bb33-4c6fa1f62730 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:07.539258 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-a827f7e0-ff4a-4485-bb33-4c6fa1f62730 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] [instance: b2c86622-4d3b-4750-9589-e485a89473cb] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:07.552148 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a827f7e0-ff4a-4485-bb33-4c6fa1f62730 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:07.552835 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a827f7e0-ff4a-4485-bb33-4c6fa1f62730 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:07.554440 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a827f7e0-ff4a-4485-bb33-4c6fa1f62730 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:07.555235 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a827f7e0-ff4a-4485-bb33-4c6fa1f62730 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:07.599563 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-fe7102a9-419d-49ed-bd60-b04567a82bc4 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:07.609968 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-fe7102a9-419d-49ed-bd60-b04567a82bc4 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:07.622609 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-fe7102a9-419d-49ed-bd60-b04567a82bc4 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:07.622609 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-fe7102a9-419d-49ed-bd60-b04567a82bc4 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1722 microversion: 2.20 time: 0.192191 Dec 15 16:26:07.622609 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 319/650] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:26:07 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:26:07.649209 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-a827f7e0-ff4a-4485-bb33-4c6fa1f62730 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b8a0a1adc54ff4abafe90692d10543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f435a136a5e44f89a0b09d4ec7427b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:07.659162 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-a827f7e0-ff4a-4485-bb33-4c6fa1f62730 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] 10.222.0.60 "GET /compute/v2.1/servers/b2c86622-4d3b-4750-9589-e485a89473cb" status: 200 len: 1279 microversion: 2.1 time: 0.124736 Dec 15 16:26:07.659891 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 332/651] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:07 2021] GET /compute/v2.1/servers/b2c86622-4d3b-4750-9589-e485a89473cb => generated 1279 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:08.639282 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-628aee3d-3d55-44cc-99f6-7b9230231848 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:08.640586 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-628aee3d-3d55-44cc-99f6-7b9230231848 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:08.647168 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-628aee3d-3d55-44cc-99f6-7b9230231848 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:08.647664 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-628aee3d-3d55-44cc-99f6-7b9230231848 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:08.648467 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-628aee3d-3d55-44cc-99f6-7b9230231848 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:08.648901 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-628aee3d-3d55-44cc-99f6-7b9230231848 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:08.680326 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e59a5d55-3574-4790-9654-ab15a05a8856 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:08.689176 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e59a5d55-3574-4790-9654-ab15a05a8856 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] [instance: b2c86622-4d3b-4750-9589-e485a89473cb] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:08.699904 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e59a5d55-3574-4790-9654-ab15a05a8856 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:08.700731 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e59a5d55-3574-4790-9654-ab15a05a8856 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:08.702128 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e59a5d55-3574-4790-9654-ab15a05a8856 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:08.702906 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e59a5d55-3574-4790-9654-ab15a05a8856 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:08.861428 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-628aee3d-3d55-44cc-99f6-7b9230231848 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:08.871362 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-628aee3d-3d55-44cc-99f6-7b9230231848 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:08.874195 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-628aee3d-3d55-44cc-99f6-7b9230231848 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:08.876001 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-628aee3d-3d55-44cc-99f6-7b9230231848 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1722 microversion: 2.20 time: 0.240064 Dec 15 16:26:08.876686 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 320/652] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:26:08 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1722 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:26:08.907936 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e59a5d55-3574-4790-9654-ab15a05a8856 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b8a0a1adc54ff4abafe90692d10543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f435a136a5e44f89a0b09d4ec7427b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:08.916479 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e59a5d55-3574-4790-9654-ab15a05a8856 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] 10.222.0.60 "GET /compute/v2.1/servers/b2c86622-4d3b-4750-9589-e485a89473cb" status: 200 len: 1319 microversion: 2.1 time: 0.242954 Dec 15 16:26:08.917061 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 333/653] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:08 2021] GET /compute/v2.1/servers/b2c86622-4d3b-4750-9589-e485a89473cb => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:26:08.962399 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-9aef7311-8b11-44b5-8aad-5234e6ec042d req-8e524e80-9ad7-4bea-8441-fdfb651fd2a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2c86622-4d3b-4750-9589-e485a89473cb", "tag": "201a5147-a21d-4bd9-8def-2ce8d86621a5"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:26:08.964252 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:26:08.964252 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Dec 15 16:26:08.973372 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-9aef7311-8b11-44b5-8aad-5234e6ec042d req-8e524e80-9ad7-4bea-8441-fdfb651fd2a9 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:08.973831 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-9aef7311-8b11-44b5-8aad-5234e6ec042d req-8e524e80-9ad7-4bea-8441-fdfb651fd2a9 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:08.988171 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-9aef7311-8b11-44b5-8aad-5234e6ec042d req-8e524e80-9ad7-4bea-8441-fdfb651fd2a9 service nova] Creating event network-changed:201a5147-a21d-4bd9-8def-2ce8d86621a5 for instance b2c86622-4d3b-4750-9589-e485a89473cb on hv-cinder-81268 Dec 15 16:26:08.994216 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-9aef7311-8b11-44b5-8aad-5234e6ec042d req-8e524e80-9ad7-4bea-8441-fdfb651fd2a9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036166 Dec 15 16:26:08.995223 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 321/654] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:26:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:26:09.896700 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f8c96eff-f3f8-4f8d-b187-7b2d62599dcd tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:09.897895 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f8c96eff-f3f8-4f8d-b187-7b2d62599dcd tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:09.905399 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f8c96eff-f3f8-4f8d-b187-7b2d62599dcd tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:09.905896 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f8c96eff-f3f8-4f8d-b187-7b2d62599dcd tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:09.906785 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f8c96eff-f3f8-4f8d-b187-7b2d62599dcd tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:09.907267 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f8c96eff-f3f8-4f8d-b187-7b2d62599dcd tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:09.934897 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-b039cadb-d3bb-411e-8cd5-6580e750da87 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:09.935613 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-b039cadb-d3bb-411e-8cd5-6580e750da87 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] [instance: b2c86622-4d3b-4750-9589-e485a89473cb] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:09.942873 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b039cadb-d3bb-411e-8cd5-6580e750da87 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:09.943314 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b039cadb-d3bb-411e-8cd5-6580e750da87 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:09.944154 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b039cadb-d3bb-411e-8cd5-6580e750da87 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:09.944603 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b039cadb-d3bb-411e-8cd5-6580e750da87 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:10.109980 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f8c96eff-f3f8-4f8d-b187-7b2d62599dcd tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:10.124379 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f8c96eff-f3f8-4f8d-b187-7b2d62599dcd tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:10.125980 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f8c96eff-f3f8-4f8d-b187-7b2d62599dcd tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:10.127162 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f8c96eff-f3f8-4f8d-b187-7b2d62599dcd tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1722 microversion: 2.20 time: 0.234601 Dec 15 16:26:10.127798 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 334/655] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:26:09 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:26:10.135460 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-b039cadb-d3bb-411e-8cd5-6580e750da87 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b8a0a1adc54ff4abafe90692d10543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f435a136a5e44f89a0b09d4ec7427b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:10.144747 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-b039cadb-d3bb-411e-8cd5-6580e750da87 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] 10.222.0.60 "GET /compute/v2.1/servers/b2c86622-4d3b-4750-9589-e485a89473cb" status: 200 len: 1319 microversion: 2.1 time: 0.213956 Dec 15 16:26:10.145326 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 322/656] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:09 2021] GET /compute/v2.1/servers/b2c86622-4d3b-4750-9589-e485a89473cb => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:11.146046 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e6b045a9-731c-47a5-918d-6ba4d5de7ba5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:11.146652 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e6b045a9-731c-47a5-918d-6ba4d5de7ba5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:11.153444 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e6b045a9-731c-47a5-918d-6ba4d5de7ba5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:11.153891 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e6b045a9-731c-47a5-918d-6ba4d5de7ba5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:11.154874 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e6b045a9-731c-47a5-918d-6ba4d5de7ba5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:11.155337 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e6b045a9-731c-47a5-918d-6ba4d5de7ba5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:11.161948 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-7709d7c6-f042-40ab-9a61-c1eedd25bb36 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:11.162534 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-7709d7c6-f042-40ab-9a61-c1eedd25bb36 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] [instance: b2c86622-4d3b-4750-9589-e485a89473cb] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:11.169488 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7709d7c6-f042-40ab-9a61-c1eedd25bb36 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:11.169906 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7709d7c6-f042-40ab-9a61-c1eedd25bb36 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:11.170692 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7709d7c6-f042-40ab-9a61-c1eedd25bb36 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:11.171139 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7709d7c6-f042-40ab-9a61-c1eedd25bb36 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:11.414136 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e6b045a9-731c-47a5-918d-6ba4d5de7ba5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:11.422774 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e6b045a9-731c-47a5-918d-6ba4d5de7ba5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:11.424670 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e6b045a9-731c-47a5-918d-6ba4d5de7ba5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:11.426578 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e6b045a9-731c-47a5-918d-6ba4d5de7ba5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1722 microversion: 2.20 time: 0.284296 Dec 15 16:26:11.427872 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 335/657] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:26:11 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1722 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:26:11.447874 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-7709d7c6-f042-40ab-9a61-c1eedd25bb36 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b8a0a1adc54ff4abafe90692d10543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f435a136a5e44f89a0b09d4ec7427b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:11.457526 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-7709d7c6-f042-40ab-9a61-c1eedd25bb36 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] 10.222.0.60 "GET /compute/v2.1/servers/b2c86622-4d3b-4750-9589-e485a89473cb" status: 200 len: 1319 microversion: 2.1 time: 0.298640 Dec 15 16:26:11.461315 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 323/658] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:11 2021] GET /compute/v2.1/servers/b2c86622-4d3b-4750-9589-e485a89473cb => generated 1319 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:26:12.447642 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c77d3a0d-9cea-4394-b715-1a29736ba686 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:12.448288 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c77d3a0d-9cea-4394-b715-1a29736ba686 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:12.455197 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c77d3a0d-9cea-4394-b715-1a29736ba686 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:12.455861 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c77d3a0d-9cea-4394-b715-1a29736ba686 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:12.456754 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c77d3a0d-9cea-4394-b715-1a29736ba686 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:12.457157 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c77d3a0d-9cea-4394-b715-1a29736ba686 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:12.483081 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-01ee0ffc-f786-4c97-baa7-e46f2dc9496b tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:12.484476 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-01ee0ffc-f786-4c97-baa7-e46f2dc9496b tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] [instance: b2c86622-4d3b-4750-9589-e485a89473cb] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:12.491893 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-01ee0ffc-f786-4c97-baa7-e46f2dc9496b tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:12.491893 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-01ee0ffc-f786-4c97-baa7-e46f2dc9496b tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:12.492714 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-01ee0ffc-f786-4c97-baa7-e46f2dc9496b tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:12.496769 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-01ee0ffc-f786-4c97-baa7-e46f2dc9496b tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:12.703725 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-c77d3a0d-9cea-4394-b715-1a29736ba686 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:12.711261 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-c77d3a0d-9cea-4394-b715-1a29736ba686 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:12.712770 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-c77d3a0d-9cea-4394-b715-1a29736ba686 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:12.713918 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c77d3a0d-9cea-4394-b715-1a29736ba686 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1743 microversion: 2.20 time: 0.270168 Dec 15 16:26:12.714476 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 336/659] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:26:12 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1743 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:26:12.726489 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-01ee0ffc-f786-4c97-baa7-e46f2dc9496b tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b8a0a1adc54ff4abafe90692d10543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f435a136a5e44f89a0b09d4ec7427b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:12.734390 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-01ee0ffc-f786-4c97-baa7-e46f2dc9496b tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] 10.222.0.60 "GET /compute/v2.1/servers/b2c86622-4d3b-4750-9589-e485a89473cb" status: 200 len: 1319 microversion: 2.1 time: 0.258124 Dec 15 16:26:12.734969 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 324/660] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:12 2021] GET /compute/v2.1/servers/b2c86622-4d3b-4750-9589-e485a89473cb => generated 1319 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:13.733966 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f2d3237d-3f90-42e6-987c-40e90daa1024 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:13.735240 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f2d3237d-3f90-42e6-987c-40e90daa1024 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:13.743122 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f2d3237d-3f90-42e6-987c-40e90daa1024 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:13.743845 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f2d3237d-3f90-42e6-987c-40e90daa1024 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:13.744822 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f2d3237d-3f90-42e6-987c-40e90daa1024 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:13.745412 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f2d3237d-3f90-42e6-987c-40e90daa1024 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:13.753294 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-c2d63473-18b1-47f9-9031-5d7d54239101 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:13.754411 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-c2d63473-18b1-47f9-9031-5d7d54239101 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] [instance: b2c86622-4d3b-4750-9589-e485a89473cb] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:13.765169 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c2d63473-18b1-47f9-9031-5d7d54239101 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:13.765629 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c2d63473-18b1-47f9-9031-5d7d54239101 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:13.766433 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c2d63473-18b1-47f9-9031-5d7d54239101 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:13.766874 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c2d63473-18b1-47f9-9031-5d7d54239101 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:13.978288 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-c2d63473-18b1-47f9-9031-5d7d54239101 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b8a0a1adc54ff4abafe90692d10543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f435a136a5e44f89a0b09d4ec7427b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:13.990285 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-c2d63473-18b1-47f9-9031-5d7d54239101 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] 10.222.0.60 "GET /compute/v2.1/servers/b2c86622-4d3b-4750-9589-e485a89473cb" status: 200 len: 1319 microversion: 2.1 time: 0.242509 Dec 15 16:26:14.000993 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f2d3237d-3f90-42e6-987c-40e90daa1024 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:14.002695 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 325/661] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:13 2021] GET /compute/v2.1/servers/b2c86622-4d3b-4750-9589-e485a89473cb => generated 1319 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:14.010821 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f2d3237d-3f90-42e6-987c-40e90daa1024 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:14.012536 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f2d3237d-3f90-42e6-987c-40e90daa1024 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:14.013881 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f2d3237d-3f90-42e6-987c-40e90daa1024 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1738 microversion: 2.20 time: 0.284067 Dec 15 16:26:14.018615 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 337/662] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:26:13 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1738 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:26:14.608817 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-13ca46fc-478a-4d56-8ad9-ba688cbcf789 req-bbc23b8f-a1f1-4ac9-8601-b7a4f43daac7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "049761b5-88eb-4325-af0e-03da2842cbf5", "name": "network-vif-plugged", "status": "completed", "tag": "71e495aa-7e03-4d0e-9f9d-b7560a684e27"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:26:14.610776 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:26:14.610776 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Dec 15 16:26:14.619328 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-13ca46fc-478a-4d56-8ad9-ba688cbcf789 req-bbc23b8f-a1f1-4ac9-8601-b7a4f43daac7 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:14.620216 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-13ca46fc-478a-4d56-8ad9-ba688cbcf789 req-bbc23b8f-a1f1-4ac9-8601-b7a4f43daac7 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:14.635218 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-13ca46fc-478a-4d56-8ad9-ba688cbcf789 req-bbc23b8f-a1f1-4ac9-8601-b7a4f43daac7 service nova] Creating event network-vif-plugged:71e495aa-7e03-4d0e-9f9d-b7560a684e27 for instance 049761b5-88eb-4325-af0e-03da2842cbf5 on hv-cinder-81268 Dec 15 16:26:14.642584 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-13ca46fc-478a-4d56-8ad9-ba688cbcf789 req-bbc23b8f-a1f1-4ac9-8601-b7a4f43daac7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039607 Dec 15 16:26:14.644327 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 326/663] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:26:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:26:15.009917 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-fdfa6af4-8dc7-43a9-8378-f374bbd2382b tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:15.011428 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-fdfa6af4-8dc7-43a9-8378-f374bbd2382b tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] [instance: b2c86622-4d3b-4750-9589-e485a89473cb] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:15.020137 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fdfa6af4-8dc7-43a9-8378-f374bbd2382b tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:15.021147 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fdfa6af4-8dc7-43a9-8378-f374bbd2382b tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:15.022113 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fdfa6af4-8dc7-43a9-8378-f374bbd2382b tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:15.022813 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fdfa6af4-8dc7-43a9-8378-f374bbd2382b tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:15.036259 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-8ec6c647-c0d0-467d-826c-65ce803bd510 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:15.037641 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-8ec6c647-c0d0-467d-826c-65ce803bd510 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:15.052262 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8ec6c647-c0d0-467d-826c-65ce803bd510 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:15.053132 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8ec6c647-c0d0-467d-826c-65ce803bd510 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:15.054161 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8ec6c647-c0d0-467d-826c-65ce803bd510 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:15.054910 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8ec6c647-c0d0-467d-826c-65ce803bd510 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:15.347504 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-8ec6c647-c0d0-467d-826c-65ce803bd510 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:15.361210 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-fdfa6af4-8dc7-43a9-8378-f374bbd2382b tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b8a0a1adc54ff4abafe90692d10543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f435a136a5e44f89a0b09d4ec7427b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:15.367601 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-8ec6c647-c0d0-467d-826c-65ce803bd510 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:15.369098 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-8ec6c647-c0d0-467d-826c-65ce803bd510 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:15.370282 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-8ec6c647-c0d0-467d-826c-65ce803bd510 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1738 microversion: 2.20 time: 0.339552 Dec 15 16:26:15.370841 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 327/664] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:26:15 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1738 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:26:15.382613 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-fdfa6af4-8dc7-43a9-8378-f374bbd2382b tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] 10.222.0.60 "GET /compute/v2.1/servers/b2c86622-4d3b-4750-9589-e485a89473cb" status: 200 len: 1319 microversion: 2.1 time: 0.377442 Dec 15 16:26:15.389409 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 338/665] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:15 2021] GET /compute/v2.1/servers/b2c86622-4d3b-4750-9589-e485a89473cb => generated 1319 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:16.389566 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-df9dec50-e76e-4904-81e6-0c6da3ebfebf tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:16.390500 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-df9dec50-e76e-4904-81e6-0c6da3ebfebf tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:16.400645 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-df9dec50-e76e-4904-81e6-0c6da3ebfebf tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:16.401464 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-df9dec50-e76e-4904-81e6-0c6da3ebfebf tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:16.401807 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-087cf161-2037-4d7a-91b0-4dc88643f8bb tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:16.402593 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-df9dec50-e76e-4904-81e6-0c6da3ebfebf tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:16.403182 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-df9dec50-e76e-4904-81e6-0c6da3ebfebf tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:16.403496 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-087cf161-2037-4d7a-91b0-4dc88643f8bb tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] [instance: b2c86622-4d3b-4750-9589-e485a89473cb] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:16.410443 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-087cf161-2037-4d7a-91b0-4dc88643f8bb tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:16.410897 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-087cf161-2037-4d7a-91b0-4dc88643f8bb tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:16.411719 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-087cf161-2037-4d7a-91b0-4dc88643f8bb tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:16.412322 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-087cf161-2037-4d7a-91b0-4dc88643f8bb tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:16.703361 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-df9dec50-e76e-4904-81e6-0c6da3ebfebf tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:16.713849 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-087cf161-2037-4d7a-91b0-4dc88643f8bb tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b8a0a1adc54ff4abafe90692d10543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f435a136a5e44f89a0b09d4ec7427b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:16.714782 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-df9dec50-e76e-4904-81e6-0c6da3ebfebf tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:16.716995 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-df9dec50-e76e-4904-81e6-0c6da3ebfebf tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:16.719190 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-df9dec50-e76e-4904-81e6-0c6da3ebfebf tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1738 microversion: 2.20 time: 0.333848 Dec 15 16:26:16.720443 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 328/666] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:26:16 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1738 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:26:16.722807 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-087cf161-2037-4d7a-91b0-4dc88643f8bb tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] 10.222.0.60 "GET /compute/v2.1/servers/b2c86622-4d3b-4750-9589-e485a89473cb" status: 200 len: 1319 microversion: 2.1 time: 0.326501 Dec 15 16:26:16.723738 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 339/667] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:16 2021] GET /compute/v2.1/servers/b2c86622-4d3b-4750-9589-e485a89473cb => generated 1319 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:26:16.732713 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-ba0970c5-7134-48b7-86fb-22292c6be6e8 req-eb392695-a04d-4566-aa1f-378581af1d46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2c86622-4d3b-4750-9589-e485a89473cb", "name": "network-vif-plugged", "status": "completed", "tag": "201a5147-a21d-4bd9-8def-2ce8d86621a5"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:26:16.734573 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:26:16.734573 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Dec 15 16:26:16.742533 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-ba0970c5-7134-48b7-86fb-22292c6be6e8 req-eb392695-a04d-4566-aa1f-378581af1d46 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:16.742978 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-ba0970c5-7134-48b7-86fb-22292c6be6e8 req-eb392695-a04d-4566-aa1f-378581af1d46 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:16.754315 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-ba0970c5-7134-48b7-86fb-22292c6be6e8 req-eb392695-a04d-4566-aa1f-378581af1d46 service nova] Creating event network-vif-plugged:201a5147-a21d-4bd9-8def-2ce8d86621a5 for instance b2c86622-4d3b-4750-9589-e485a89473cb on hv-cinder-81268 Dec 15 16:26:16.759344 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-ba0970c5-7134-48b7-86fb-22292c6be6e8 req-eb392695-a04d-4566-aa1f-378581af1d46 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037442 Dec 15 16:26:16.759990 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 329/668] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:26:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:26:17.756035 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-6ed1cacd-dcb5-44e9-ba6d-0c7f98ba5bf2 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:17.757807 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-cbdac2d3-cade-4c16-abea-388b5402ad03 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:17.758484 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-cbdac2d3-cade-4c16-abea-388b5402ad03 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] [instance: b2c86622-4d3b-4750-9589-e485a89473cb] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:17.765359 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-6ed1cacd-dcb5-44e9-ba6d-0c7f98ba5bf2 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:17.774417 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6ed1cacd-dcb5-44e9-ba6d-0c7f98ba5bf2 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:17.774888 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6ed1cacd-dcb5-44e9-ba6d-0c7f98ba5bf2 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:17.775795 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6ed1cacd-dcb5-44e9-ba6d-0c7f98ba5bf2 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:17.780447 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-cbdac2d3-cade-4c16-abea-388b5402ad03 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:17.782233 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6ed1cacd-dcb5-44e9-ba6d-0c7f98ba5bf2 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:17.785665 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-cbdac2d3-cade-4c16-abea-388b5402ad03 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:17.786742 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-cbdac2d3-cade-4c16-abea-388b5402ad03 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:17.787338 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-cbdac2d3-cade-4c16-abea-388b5402ad03 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:18.024027 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-6ed1cacd-dcb5-44e9-ba6d-0c7f98ba5bf2 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:18.037998 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-cbdac2d3-cade-4c16-abea-388b5402ad03 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b8a0a1adc54ff4abafe90692d10543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f435a136a5e44f89a0b09d4ec7427b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:18.042959 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-6ed1cacd-dcb5-44e9-ba6d-0c7f98ba5bf2 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:18.045538 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-6ed1cacd-dcb5-44e9-ba6d-0c7f98ba5bf2 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:18.046940 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-6ed1cacd-dcb5-44e9-ba6d-0c7f98ba5bf2 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1738 microversion: 2.20 time: 0.312684 Dec 15 16:26:18.047070 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-cbdac2d3-cade-4c16-abea-388b5402ad03 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] 10.222.0.60 "GET /compute/v2.1/servers/b2c86622-4d3b-4750-9589-e485a89473cb" status: 200 len: 1319 microversion: 2.1 time: 0.310511 Dec 15 16:26:18.047652 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 330/669] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:17 2021] GET /compute/v2.1/servers/b2c86622-4d3b-4750-9589-e485a89473cb => generated 1319 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:18.058460 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 340/670] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:26:17 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1738 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:26:18.571956 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-94a07f02-a8eb-4b8b-b754-497b3d9031f3 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:18.573222 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-94a07f02-a8eb-4b8b-b754-497b3d9031f3 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:18.579574 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-94a07f02-a8eb-4b8b-b754-497b3d9031f3 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:18.580220 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-94a07f02-a8eb-4b8b-b754-497b3d9031f3 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:18.581012 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-94a07f02-a8eb-4b8b-b754-497b3d9031f3 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:18.581449 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-94a07f02-a8eb-4b8b-b754-497b3d9031f3 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:18.614479 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-94a07f02-a8eb-4b8b-b754-497b3d9031f3 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046124 Dec 15 16:26:18.615129 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 331/671] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Dec 15 16:26:18 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:26:18.677355 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1cf0c382-ce95-4b52-aae2-08d9546d1887 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:18.677945 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1cf0c382-ce95-4b52-aae2-08d9546d1887 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:18.685105 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1cf0c382-ce95-4b52-aae2-08d9546d1887 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:18.685610 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1cf0c382-ce95-4b52-aae2-08d9546d1887 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:18.686628 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1cf0c382-ce95-4b52-aae2-08d9546d1887 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:18.687123 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1cf0c382-ce95-4b52-aae2-08d9546d1887 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:18.714886 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1cf0c382-ce95-4b52-aae2-08d9546d1887 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Going to try to terminate instance {{(pid=116084) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:26:18.801276 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1cf0c382-ce95-4b52-aae2-08d9546d1887 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 204 len: 0 microversion: 2.1 time: 0.127218 Dec 15 16:26:18.803400 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 341/672] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Dec 15 16:26:18 2021] DELETE /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:26:18.817731 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-c3ae17f7-71b3-4637-896f-934657341c0f tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:18.819213 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-c3ae17f7-71b3-4637-896f-934657341c0f tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:18.827266 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c3ae17f7-71b3-4637-896f-934657341c0f tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:18.828048 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c3ae17f7-71b3-4637-896f-934657341c0f tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:18.829048 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c3ae17f7-71b3-4637-896f-934657341c0f tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:18.829801 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c3ae17f7-71b3-4637-896f-934657341c0f tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:19.013791 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-c3ae17f7-71b3-4637-896f-934657341c0f tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:19.022792 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-c3ae17f7-71b3-4637-896f-934657341c0f tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1673 microversion: 2.1 time: 0.215094 Dec 15 16:26:19.023540 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 332/673] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:18 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1673 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:19.067988 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-38d1c51f-16e3-4772-a9a4-cd23bc0885ff tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:19.068745 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-38d1c51f-16e3-4772-a9a4-cd23bc0885ff tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:19.069124 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-58d07208-53e8-4361-aa7c-71ff9abf1b72 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:19.070033 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-58d07208-53e8-4361-aa7c-71ff9abf1b72 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] [instance: b2c86622-4d3b-4750-9589-e485a89473cb] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:19.075044 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-38d1c51f-16e3-4772-a9a4-cd23bc0885ff tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:19.076500 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-38d1c51f-16e3-4772-a9a4-cd23bc0885ff tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:19.077231 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-58d07208-53e8-4361-aa7c-71ff9abf1b72 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:19.077668 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-38d1c51f-16e3-4772-a9a4-cd23bc0885ff tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:19.077791 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-58d07208-53e8-4361-aa7c-71ff9abf1b72 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:19.078369 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-38d1c51f-16e3-4772-a9a4-cd23bc0885ff tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:19.078503 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-58d07208-53e8-4361-aa7c-71ff9abf1b72 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:19.079065 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-58d07208-53e8-4361-aa7c-71ff9abf1b72 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:19.295005 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-38d1c51f-16e3-4772-a9a4-cd23bc0885ff tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:19.298371 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-58d07208-53e8-4361-aa7c-71ff9abf1b72 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b8a0a1adc54ff4abafe90692d10543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f435a136a5e44f89a0b09d4ec7427b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:19.306541 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-58d07208-53e8-4361-aa7c-71ff9abf1b72 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] 10.222.0.60 "GET /compute/v2.1/servers/b2c86622-4d3b-4750-9589-e485a89473cb" status: 200 len: 1506 microversion: 2.1 time: 0.243829 Dec 15 16:26:19.308127 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 342/674] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:19 2021] GET /compute/v2.1/servers/b2c86622-4d3b-4750-9589-e485a89473cb => generated 1506 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:19.310983 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-38d1c51f-16e3-4772-a9a4-cd23bc0885ff tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:19.315990 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-38d1c51f-16e3-4772-a9a4-cd23bc0885ff tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:19.318861 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-38d1c51f-16e3-4772-a9a4-cd23bc0885ff tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1738 microversion: 2.20 time: 0.254220 Dec 15 16:26:19.320124 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 333/675] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:26:19 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1738 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:26:19.349299 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-089e91ed-44f5-4755-b209-9cf3aff17093 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63f86b22-ef95-4fae-83f6-f9f4e5605d2a", "device": "/dev/sdb"}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:26:19.353285 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-089e91ed-44f5-4755-b209-9cf3aff17093 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] [instance: b2c86622-4d3b-4750-9589-e485a89473cb] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:19.360981 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-089e91ed-44f5-4755-b209-9cf3aff17093 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:19.361709 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-089e91ed-44f5-4755-b209-9cf3aff17093 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:19.362585 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-089e91ed-44f5-4755-b209-9cf3aff17093 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:19.362958 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-089e91ed-44f5-4755-b209-9cf3aff17093 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:19.629416 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-089e91ed-44f5-4755-b209-9cf3aff17093 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] 10.222.0.60 "POST /compute/v2.1/servers/b2c86622-4d3b-4750-9589-e485a89473cb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298346 Dec 15 16:26:19.630532 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 343/676] 10.222.0.60 () {60 vars in 1322 bytes} [Wed Dec 15 16:26:19 2021] POST /compute/v2.1/servers/b2c86622-4d3b-4750-9589-e485a89473cb/os-volume_attachments => generated 194 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:26:20.051601 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-b0a7a1a8-0e9d-40dc-868f-acdd53fc0fb9 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:20.052276 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-b0a7a1a8-0e9d-40dc-868f-acdd53fc0fb9 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:20.058507 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b0a7a1a8-0e9d-40dc-868f-acdd53fc0fb9 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:20.059226 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b0a7a1a8-0e9d-40dc-868f-acdd53fc0fb9 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:20.060249 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b0a7a1a8-0e9d-40dc-868f-acdd53fc0fb9 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:20.060859 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b0a7a1a8-0e9d-40dc-868f-acdd53fc0fb9 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:20.269718 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-b0a7a1a8-0e9d-40dc-868f-acdd53fc0fb9 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:20.278645 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-b0a7a1a8-0e9d-40dc-868f-acdd53fc0fb9 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1673 microversion: 2.1 time: 0.230945 Dec 15 16:26:20.279293 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 334/677] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:20 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1673 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:26:20.360840 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0dc18e37-cb9b-4fb6-b518-e542e56ea28c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:20.362998 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-0dc18e37-cb9b-4fb6-b518-e542e56ea28c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:20.386838 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0dc18e37-cb9b-4fb6-b518-e542e56ea28c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:20.389056 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0dc18e37-cb9b-4fb6-b518-e542e56ea28c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:20.417943 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0dc18e37-cb9b-4fb6-b518-e542e56ea28c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:20.418940 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0dc18e37-cb9b-4fb6-b518-e542e56ea28c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:20.585886 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-0dc18e37-cb9b-4fb6-b518-e542e56ea28c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:20.595293 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-0dc18e37-cb9b-4fb6-b518-e542e56ea28c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:20.600325 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-0dc18e37-cb9b-4fb6-b518-e542e56ea28c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:20.602409 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0dc18e37-cb9b-4fb6-b518-e542e56ea28c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1738 microversion: 2.20 time: 0.252069 Dec 15 16:26:20.603052 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 344/678] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:26:20 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1738 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:26:21.299409 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-6feb29bc-3686-4458-9a26-7ebe99dcc1e0 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:21.300662 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-6feb29bc-3686-4458-9a26-7ebe99dcc1e0 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:21.307703 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6feb29bc-3686-4458-9a26-7ebe99dcc1e0 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:21.308380 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6feb29bc-3686-4458-9a26-7ebe99dcc1e0 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:21.309439 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6feb29bc-3686-4458-9a26-7ebe99dcc1e0 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:21.310073 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6feb29bc-3686-4458-9a26-7ebe99dcc1e0 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:21.507701 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-6feb29bc-3686-4458-9a26-7ebe99dcc1e0 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:21.519184 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-6feb29bc-3686-4458-9a26-7ebe99dcc1e0 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1673 microversion: 2.1 time: 0.223629 Dec 15 16:26:21.530748 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 335/679] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:21 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1673 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:21.622297 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-6be82eb6-5c7e-47d5-b6d9-122b32382bad tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:21.623724 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-6be82eb6-5c7e-47d5-b6d9-122b32382bad tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:21.630525 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6be82eb6-5c7e-47d5-b6d9-122b32382bad tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:21.631470 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6be82eb6-5c7e-47d5-b6d9-122b32382bad tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:21.632644 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6be82eb6-5c7e-47d5-b6d9-122b32382bad tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:21.633300 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6be82eb6-5c7e-47d5-b6d9-122b32382bad tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:21.864039 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-6be82eb6-5c7e-47d5-b6d9-122b32382bad tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:21.874249 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-6be82eb6-5c7e-47d5-b6d9-122b32382bad tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:21.876866 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-6be82eb6-5c7e-47d5-b6d9-122b32382bad tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:21.878913 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-6be82eb6-5c7e-47d5-b6d9-122b32382bad tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1738 microversion: 2.20 time: 0.260665 Dec 15 16:26:21.879516 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 345/680] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:26:21 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1738 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:26:22.413553 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-473c4b7e-514d-45ce-b951-1f9eaab43f83 req-eaa740fa-6431-43c2-86c4-4b5d6ebc6e70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f48359cf-b1e0-4786-885d-3aa339bbf38a", "name": "network-vif-deleted", "tag": "65d0d9cf-d833-47a5-8f8a-740b194ba7ff"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:26:22.415146 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:26:22.415146 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Dec 15 16:26:22.423985 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-473c4b7e-514d-45ce-b951-1f9eaab43f83 req-eaa740fa-6431-43c2-86c4-4b5d6ebc6e70 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:22.424689 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-473c4b7e-514d-45ce-b951-1f9eaab43f83 req-eaa740fa-6431-43c2-86c4-4b5d6ebc6e70 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:22.438713 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-473c4b7e-514d-45ce-b951-1f9eaab43f83 req-eaa740fa-6431-43c2-86c4-4b5d6ebc6e70 service nova] Creating event network-vif-deleted:65d0d9cf-d833-47a5-8f8a-740b194ba7ff for instance f48359cf-b1e0-4786-885d-3aa339bbf38a on hv-cinder-81268 Dec 15 16:26:22.444509 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-473c4b7e-514d-45ce-b951-1f9eaab43f83 req-eaa740fa-6431-43c2-86c4-4b5d6ebc6e70 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034605 Dec 15 16:26:22.449653 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 336/681] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:26:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:26:22.538023 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-6b67750e-9ba1-415f-b133-2f51acb6b815 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:22.539163 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-6b67750e-9ba1-415f-b133-2f51acb6b815 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:22.548056 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6b67750e-9ba1-415f-b133-2f51acb6b815 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:22.548854 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6b67750e-9ba1-415f-b133-2f51acb6b815 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:22.550296 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6b67750e-9ba1-415f-b133-2f51acb6b815 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:22.550961 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6b67750e-9ba1-415f-b133-2f51acb6b815 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:22.610059 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6b67750e-9ba1-415f-b133-2f51acb6b815 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:22.611010 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6b67750e-9ba1-415f-b133-2f51acb6b815 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:22.611684 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.objects.instance [None req-6b67750e-9ba1-415f-b133-2f51acb6b815 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lazy-loading 'fault' on Instance uuid f48359cf-b1e0-4786-885d-3aa339bbf38a {{(pid=116084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:26:22.683179 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-6b67750e-9ba1-415f-b133-2f51acb6b815 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:22.692163 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-6b67750e-9ba1-415f-b133-2f51acb6b815 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 200 len: 1326 microversion: 2.1 time: 0.159128 Dec 15 16:26:22.692951 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 346/682] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:22 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 1326 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:22.899710 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-67aad617-6196-4fa1-ac82-92108e2fd17e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:22.900692 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-67aad617-6196-4fa1-ac82-92108e2fd17e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:22.921535 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-67aad617-6196-4fa1-ac82-92108e2fd17e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:22.923579 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-67aad617-6196-4fa1-ac82-92108e2fd17e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:22.928584 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-67aad617-6196-4fa1-ac82-92108e2fd17e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:22.929045 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-67aad617-6196-4fa1-ac82-92108e2fd17e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:23.224257 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-67aad617-6196-4fa1-ac82-92108e2fd17e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:23.236808 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-67aad617-6196-4fa1-ac82-92108e2fd17e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:23.239340 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-67aad617-6196-4fa1-ac82-92108e2fd17e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:23.241485 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-67aad617-6196-4fa1-ac82-92108e2fd17e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1738 microversion: 2.20 time: 0.347383 Dec 15 16:26:23.243836 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 337/683] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:26:22 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1738 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:26:23.709661 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-cb505d21-bc72-4755-b58b-2e4a09d9a5cd tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:23.711079 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-cb505d21-bc72-4755-b58b-2e4a09d9a5cd tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:23.730260 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cb505d21-bc72-4755-b58b-2e4a09d9a5cd tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:23.730741 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cb505d21-bc72-4755-b58b-2e4a09d9a5cd tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:23.733642 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cb505d21-bc72-4755-b58b-2e4a09d9a5cd tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:23.734317 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cb505d21-bc72-4755-b58b-2e4a09d9a5cd tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:23.774932 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-cb505d21-bc72-4755-b58b-2e4a09d9a5cd tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] HTTP exception thrown: Instance f48359cf-b1e0-4786-885d-3aa339bbf38a could not be found. Dec 15 16:26:23.775720 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-cb505d21-bc72-4755-b58b-2e4a09d9a5cd tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Returning 404 to user: Instance f48359cf-b1e0-4786-885d-3aa339bbf38a could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:26:23.776572 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-cb505d21-bc72-4755-b58b-2e4a09d9a5cd tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 404 len: 111 microversion: 2.1 time: 0.071038 Dec 15 16:26:23.777197 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 347/684] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:23 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:26:23.788262 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-052e5e75-4dc9-4035-976c-8c82826fd0e9 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '.version_select at 0x7f0b26a66700>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:23.829114 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-052e5e75-4dc9-4035-976c-8c82826fd0e9 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-123014102" status: 202 len: 0 microversion: 2.1 time: 0.044823 Dec 15 16:26:23.830056 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 338/685] 10.222.0.60 () {58 vars in 1217 bytes} [Wed Dec 15 16:26:23 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-123014102 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:26:24.264832 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-56a6408d-5fbd-4dbd-a241-b55ab1a4d434 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:24.267979 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-56a6408d-5fbd-4dbd-a241-b55ab1a4d434 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:24.292155 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-56a6408d-5fbd-4dbd-a241-b55ab1a4d434 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:24.293228 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-56a6408d-5fbd-4dbd-a241-b55ab1a4d434 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:24.295738 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-56a6408d-5fbd-4dbd-a241-b55ab1a4d434 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:24.296519 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-56a6408d-5fbd-4dbd-a241-b55ab1a4d434 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:24.572525 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-56a6408d-5fbd-4dbd-a241-b55ab1a4d434 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:24.596615 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-56a6408d-5fbd-4dbd-a241-b55ab1a4d434 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:24.598890 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-56a6408d-5fbd-4dbd-a241-b55ab1a4d434 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:24.601698 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-56a6408d-5fbd-4dbd-a241-b55ab1a4d434 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1738 microversion: 2.20 time: 0.344371 Dec 15 16:26:24.612098 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 348/686] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:26:24 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1738 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:26:25.036582 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-72e553a5-e86d-44e4-a58f-fe16e545314c tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'create', calling method: .version_select at 0x7f0b26b679d0>, body: {"keypair": {"name": "tempest-keypair-654256954"}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:26:25.053122 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-72e553a5-e86d-44e4-a58f-fe16e545314c tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Getting quotas for project 28737128a7574d248ba7e4e536171af2. Resources: {'key_pairs'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:26:25.058390 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-72e553a5-e86d-44e4-a58f-fe16e545314c tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Getting quotas for user 99b3403e60df4fbd9a5fdffe01a5efb7 and project 28737128a7574d248ba7e4e536171af2. Resources: {'key_pairs'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:26:25.225789 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-72e553a5-e86d-44e4-a58f-fe16e545314c tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Getting quotas for project 28737128a7574d248ba7e4e536171af2. Resources: {'key_pairs'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:26:25.230253 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-72e553a5-e86d-44e4-a58f-fe16e545314c tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Getting quotas for user 99b3403e60df4fbd9a5fdffe01a5efb7 and project 28737128a7574d248ba7e4e536171af2. Resources: {'key_pairs'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:26:25.244044 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-72e553a5-e86d-44e4-a58f-fe16e545314c tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.213038 Dec 15 16:26:25.244832 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 339/687] 10.222.0.60 () {60 vars in 1157 bytes} [Wed Dec 15 16:26:25 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:25.638635 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-6d45a14d-7073-49cb-a056-25302e524ba0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:25.639250 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-6d45a14d-7073-49cb-a056-25302e524ba0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:25.661580 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6d45a14d-7073-49cb-a056-25302e524ba0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:25.662765 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6d45a14d-7073-49cb-a056-25302e524ba0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:25.664240 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6d45a14d-7073-49cb-a056-25302e524ba0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:25.664926 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6d45a14d-7073-49cb-a056-25302e524ba0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:25.896505 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-6d45a14d-7073-49cb-a056-25302e524ba0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:25.904606 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-6d45a14d-7073-49cb-a056-25302e524ba0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:25.906237 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-6d45a14d-7073-49cb-a056-25302e524ba0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:25.907640 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-6d45a14d-7073-49cb-a056-25302e524ba0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1720 microversion: 2.20 time: 0.279425 Dec 15 16:26:25.908389 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 349/688] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:26:25 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1720 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:26:26.746168 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-57e1d020-5760-49ac-a3e1-16652c8364d6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-548162534", "imageRef": "b72b5f54-34d0-48ac-9484-bc8104a6dddb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "514727e8-0179-4c06-9ef8-e0775da37a12"}], "security_groups": [{"name": "tempest-securitygroup--1557492320"}], "key_name": "tempest-keypair-654256954", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:26:26.853010 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.network.neutron [None req-57e1d020-5760-49ac-a3e1-16652c8364d6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] validate_networks() for [('514727e8-0179-4c06-9ef8-e0775da37a12', None, None, None, None, None)] {{(pid=116085) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:26:26.926717 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e008e7f2-3446-4061-9a48-97c23393b1ab tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:26.927651 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e008e7f2-3446-4061-9a48-97c23393b1ab tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:26.934124 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e008e7f2-3446-4061-9a48-97c23393b1ab tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:26.934678 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e008e7f2-3446-4061-9a48-97c23393b1ab tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:26.935756 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e008e7f2-3446-4061-9a48-97c23393b1ab tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:26.936194 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e008e7f2-3446-4061-9a48-97c23393b1ab tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:27.160387 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e008e7f2-3446-4061-9a48-97c23393b1ab tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:27.168645 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e008e7f2-3446-4061-9a48-97c23393b1ab tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:27.170277 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e008e7f2-3446-4061-9a48-97c23393b1ab tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:27.171423 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e008e7f2-3446-4061-9a48-97c23393b1ab tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1720 microversion: 2.20 time: 0.248808 Dec 15 16:26:27.172002 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 350/689] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:26:26 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1720 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:26:27.298288 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-57e1d020-5760-49ac-a3e1-16652c8364d6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Flavor limits 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:26:27.298847 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-57e1d020-5760-49ac-a3e1-16652c8364d6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Image limits 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:26:27.299313 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-57e1d020-5760-49ac-a3e1-16652c8364d6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Flavor pref 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:26:27.299891 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-57e1d020-5760-49ac-a3e1-16652c8364d6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Image pref 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:26:27.300483 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-57e1d020-5760-49ac-a3e1-16652c8364d6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:26:27.310242 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-57e1d020-5760-49ac-a3e1-16652c8364d6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:27.310692 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-57e1d020-5760-49ac-a3e1-16652c8364d6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:27.311522 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-57e1d020-5760-49ac-a3e1-16652c8364d6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:27.311952 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-57e1d020-5760-49ac-a3e1-16652c8364d6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:27.334170 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-57e1d020-5760-49ac-a3e1-16652c8364d6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Getting quotas for project 28737128a7574d248ba7e4e536171af2. Resources: {'cores', 'instances', 'ram'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:26:27.338509 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-57e1d020-5760-49ac-a3e1-16652c8364d6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Getting quotas for user 99b3403e60df4fbd9a5fdffe01a5efb7 and project 28737128a7574d248ba7e4e536171af2. Resources: {'cores', 'instances', 'ram'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:26:27.350384 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-57e1d020-5760-49ac-a3e1-16652c8364d6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Going to run 1 instances... {{(pid=116085) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:26:27.352900 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-57e1d020-5760-49ac-a3e1-16652c8364d6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b72b5f54-34d0-48ac-9484-bc8104a6dddb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116085) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:26:27.405589 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-57e1d020-5760-49ac-a3e1-16652c8364d6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.663936 Dec 15 16:26:27.406255 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 340/690] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Dec 15 16:26:26 2021] POST /compute/v2.1/servers => generated 402 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 16:26:27.417972 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-30af41e5-146c-4670-9666-9f70e3b74369 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:27.418942 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-30af41e5-146c-4670-9666-9f70e3b74369 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:27.498109 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-30af41e5-146c-4670-9666-9f70e3b74369 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:27.507717 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-30af41e5-146c-4670-9666-9f70e3b74369 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82" status: 200 len: 1236 microversion: 2.1 time: 0.094432 Dec 15 16:26:27.508843 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 351/691] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:27 2021] GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82 => generated 1236 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:28.190872 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-01f0d51d-8916-408b-ae4d-876073b830d7 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:28.191563 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-01f0d51d-8916-408b-ae4d-876073b830d7 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:28.198210 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-01f0d51d-8916-408b-ae4d-876073b830d7 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:28.198679 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-01f0d51d-8916-408b-ae4d-876073b830d7 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:28.199511 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-01f0d51d-8916-408b-ae4d-876073b830d7 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:28.199966 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-01f0d51d-8916-408b-ae4d-876073b830d7 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:28.342523 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-01f0d51d-8916-408b-ae4d-876073b830d7 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:28.351045 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-01f0d51d-8916-408b-ae4d-876073b830d7 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:28.352617 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-01f0d51d-8916-408b-ae4d-876073b830d7 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:28.353785 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-01f0d51d-8916-408b-ae4d-876073b830d7 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1720 microversion: 2.20 time: 0.167275 Dec 15 16:26:28.354363 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 341/692] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:26:28 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1720 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:26:28.525586 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-14067179-3fad-4305-8cbd-0101fea35781 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:28.526379 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-14067179-3fad-4305-8cbd-0101fea35781 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:28.533891 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-14067179-3fad-4305-8cbd-0101fea35781 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:28.534335 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-14067179-3fad-4305-8cbd-0101fea35781 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:28.535195 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-14067179-3fad-4305-8cbd-0101fea35781 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:28.535776 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-14067179-3fad-4305-8cbd-0101fea35781 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:28.606204 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-14067179-3fad-4305-8cbd-0101fea35781 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:28.612405 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-6635d594-d03c-47ed-b263-6c027088b951 req-83c0cc87-28a7-4352-b26c-d249a0d2b42a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "049761b5-88eb-4325-af0e-03da2842cbf5", "name": "network-vif-unplugged", "status": "completed", "tag": "71e495aa-7e03-4d0e-9f9d-b7560a684e27"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:26:28.614962 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:26:28.614962 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Dec 15 16:26:28.615526 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-14067179-3fad-4305-8cbd-0101fea35781 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82" status: 200 len: 1240 microversion: 2.1 time: 0.093772 Dec 15 16:26:28.616133 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 352/693] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:28 2021] GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82 => generated 1240 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:28.622775 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-6635d594-d03c-47ed-b263-6c027088b951 req-83c0cc87-28a7-4352-b26c-d249a0d2b42a service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:28.623224 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-6635d594-d03c-47ed-b263-6c027088b951 req-83c0cc87-28a7-4352-b26c-d249a0d2b42a service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:28.641679 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-6635d594-d03c-47ed-b263-6c027088b951 req-83c0cc87-28a7-4352-b26c-d249a0d2b42a service nova] Creating event network-vif-unplugged:71e495aa-7e03-4d0e-9f9d-b7560a684e27 for instance 049761b5-88eb-4325-af0e-03da2842cbf5 on hv-cinder-81268 Dec 15 16:26:28.647817 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-6635d594-d03c-47ed-b263-6c027088b951 req-83c0cc87-28a7-4352-b26c-d249a0d2b42a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039785 Dec 15 16:26:28.649156 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 342/694] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:26:28 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:26:29.375799 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-3ca2d119-183a-416b-90f6-20df23ca6a3c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:29.376554 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-3ca2d119-183a-416b-90f6-20df23ca6a3c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:29.385283 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3ca2d119-183a-416b-90f6-20df23ca6a3c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:29.385718 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3ca2d119-183a-416b-90f6-20df23ca6a3c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:29.386519 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3ca2d119-183a-416b-90f6-20df23ca6a3c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:29.386945 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3ca2d119-183a-416b-90f6-20df23ca6a3c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:29.562570 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-3ca2d119-183a-416b-90f6-20df23ca6a3c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:29.581721 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-3ca2d119-183a-416b-90f6-20df23ca6a3c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:29.584379 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-3ca2d119-183a-416b-90f6-20df23ca6a3c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:29.586576 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-3ca2d119-183a-416b-90f6-20df23ca6a3c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1720 microversion: 2.20 time: 0.216195 Dec 15 16:26:29.589699 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 353/695] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:26:29 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1720 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:26:29.635280 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-5d74b9f8-7f38-491d-b5d9-f28fcbff069c tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:29.636582 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-5d74b9f8-7f38-491d-b5d9-f28fcbff069c tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:29.646511 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5d74b9f8-7f38-491d-b5d9-f28fcbff069c tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:29.647099 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5d74b9f8-7f38-491d-b5d9-f28fcbff069c tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:29.648743 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5d74b9f8-7f38-491d-b5d9-f28fcbff069c tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:29.649311 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5d74b9f8-7f38-491d-b5d9-f28fcbff069c tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:29.717898 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-5d74b9f8-7f38-491d-b5d9-f28fcbff069c tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:29.723447 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-4fbf863b-17b9-4427-a442-ce00f6b38489 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:26:29.724172 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-4fbf863b-17b9-4427-a442-ce00f6b38489 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:29.728944 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-5d74b9f8-7f38-491d-b5d9-f28fcbff069c tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82" status: 200 len: 1232 microversion: 2.1 time: 0.099303 Dec 15 16:26:29.729921 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 343/696] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:29 2021] GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82 => generated 1232 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:29.732428 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4fbf863b-17b9-4427-a442-ce00f6b38489 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:29.732903 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4fbf863b-17b9-4427-a442-ce00f6b38489 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:29.735584 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4fbf863b-17b9-4427-a442-ce00f6b38489 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:29.736095 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4fbf863b-17b9-4427-a442-ce00f6b38489 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:29.772532 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.objects.instance [None req-4fbf863b-17b9-4427-a442-ce00f6b38489 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lazy-loading 'flavor' on Instance uuid afd5ac96-daf3-4608-818c-190e076c2f6d {{(pid=116084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:26:29.861635 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-4fbf863b-17b9-4427-a442-ce00f6b38489 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "POST /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d/action" status: 202 len: 0 microversion: 2.1 time: 0.142312 Dec 15 16:26:29.862096 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 354/697] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:26:29 2021] POST /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:26:29.873447 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-049e2d06-f6e9-472d-a085-74087060089e tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:29.874462 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-049e2d06-f6e9-472d-a085-74087060089e tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:29.882093 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-049e2d06-f6e9-472d-a085-74087060089e tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:29.882631 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-049e2d06-f6e9-472d-a085-74087060089e tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:29.883527 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-049e2d06-f6e9-472d-a085-74087060089e tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:29.884157 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-049e2d06-f6e9-472d-a085-74087060089e tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:30.069357 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-049e2d06-f6e9-472d-a085-74087060089e tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b554f95b7b4444ab70e9dabf8197de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fc732badb0488392694e6d6c67d5dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:30.081399 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-049e2d06-f6e9-472d-a085-74087060089e tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d" status: 200 len: 1568 microversion: 2.1 time: 0.212549 Dec 15 16:26:30.082395 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 344/698] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:29 2021] GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d => generated 1568 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:26:30.610912 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d184ba39-063c-40ba-ada4-82b5c6b847d2 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:30.612248 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d184ba39-063c-40ba-ada4-82b5c6b847d2 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:30.620816 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d184ba39-063c-40ba-ada4-82b5c6b847d2 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:30.621238 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d184ba39-063c-40ba-ada4-82b5c6b847d2 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:30.622141 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d184ba39-063c-40ba-ada4-82b5c6b847d2 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:30.622570 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d184ba39-063c-40ba-ada4-82b5c6b847d2 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:30.752162 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-9a0ec336-4b4c-4b6f-a54e-ed7779d3a8df tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:30.753475 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-9a0ec336-4b4c-4b6f-a54e-ed7779d3a8df tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:30.765568 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9a0ec336-4b4c-4b6f-a54e-ed7779d3a8df tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:30.766668 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9a0ec336-4b4c-4b6f-a54e-ed7779d3a8df tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:30.769476 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9a0ec336-4b4c-4b6f-a54e-ed7779d3a8df tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:30.770593 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9a0ec336-4b4c-4b6f-a54e-ed7779d3a8df tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:30.841476 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d184ba39-063c-40ba-ada4-82b5c6b847d2 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:30.849952 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d184ba39-063c-40ba-ada4-82b5c6b847d2 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:30.852404 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d184ba39-063c-40ba-ada4-82b5c6b847d2 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:30.853646 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d184ba39-063c-40ba-ada4-82b5c6b847d2 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1663 microversion: 2.20 time: 0.249637 Dec 15 16:26:30.854710 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 355/699] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:26:30 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1663 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:26:30.877448 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-9a0ec336-4b4c-4b6f-a54e-ed7779d3a8df tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:30.883550 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-2e38ec2c-5d09-46a7-b5bd-cb26f8ddaabf tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1715dbbd-bf71-4f87-afed-f1b6389838c0"}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:26:30.884618 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-2e38ec2c-5d09-46a7-b5bd-cb26f8ddaabf tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:30.886936 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-9a0ec336-4b4c-4b6f-a54e-ed7779d3a8df tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82" status: 200 len: 1294 microversion: 2.1 time: 0.141428 Dec 15 16:26:30.887718 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 345/700] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:30 2021] GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82 => generated 1294 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:26:30.893675 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2e38ec2c-5d09-46a7-b5bd-cb26f8ddaabf tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:30.894224 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2e38ec2c-5d09-46a7-b5bd-cb26f8ddaabf tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:30.895082 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2e38ec2c-5d09-46a7-b5bd-cb26f8ddaabf tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:30.895710 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2e38ec2c-5d09-46a7-b5bd-cb26f8ddaabf tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:31.101788 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-98f4ac64-cda1-4980-9eed-0c8fc7b97475 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:31.102498 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-98f4ac64-cda1-4980-9eed-0c8fc7b97475 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:31.112079 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-98f4ac64-cda1-4980-9eed-0c8fc7b97475 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:31.112776 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-98f4ac64-cda1-4980-9eed-0c8fc7b97475 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:31.113927 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-98f4ac64-cda1-4980-9eed-0c8fc7b97475 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:31.114581 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-98f4ac64-cda1-4980-9eed-0c8fc7b97475 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:31.280393 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-98f4ac64-cda1-4980-9eed-0c8fc7b97475 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b554f95b7b4444ab70e9dabf8197de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fc732badb0488392694e6d6c67d5dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:31.292376 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-98f4ac64-cda1-4980-9eed-0c8fc7b97475 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d" status: 200 len: 1568 microversion: 2.1 time: 0.195754 Dec 15 16:26:31.293271 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 346/701] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:31 2021] GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d => generated 1568 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:31.313720 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-2e38ec2c-5d09-46a7-b5bd-cb26f8ddaabf tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.434258 Dec 15 16:26:31.314341 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 356/702] 10.222.0.60 () {62 vars in 1363 bytes} [Wed Dec 15 16:26:30 2021] POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/os-volume_attachments => generated 188 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:26:31.437034 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-c1652770-0c5e-41d1-b61e-b0b2cbfff3bc tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:26:31.437619 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-c1652770-0c5e-41d1-b61e-b0b2cbfff3bc tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:31.443482 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c1652770-0c5e-41d1-b61e-b0b2cbfff3bc tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:31.443933 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c1652770-0c5e-41d1-b61e-b0b2cbfff3bc tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:31.444902 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c1652770-0c5e-41d1-b61e-b0b2cbfff3bc tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:31.445331 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c1652770-0c5e-41d1-b61e-b0b2cbfff3bc tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:31.545371 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-c1652770-0c5e-41d1-b61e-b0b2cbfff3bc tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action" status: 202 len: 0 microversion: 2.20 time: 0.112755 Dec 15 16:26:31.545987 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 347/703] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:26:31 2021] POST /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:26:31.554190 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-444177a0-e459-4a61-a574-d8ebe079a617 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:31.554893 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-444177a0-e459-4a61-a574-d8ebe079a617 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:31.562105 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-444177a0-e459-4a61-a574-d8ebe079a617 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:31.562551 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-444177a0-e459-4a61-a574-d8ebe079a617 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:31.563358 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-444177a0-e459-4a61-a574-d8ebe079a617 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:31.563993 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-444177a0-e459-4a61-a574-d8ebe079a617 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:31.701258 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-444177a0-e459-4a61-a574-d8ebe079a617 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:31.711611 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-444177a0-e459-4a61-a574-d8ebe079a617 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:31.712649 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-444177a0-e459-4a61-a574-d8ebe079a617 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:31.715326 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-444177a0-e459-4a61-a574-d8ebe079a617 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1749 microversion: 2.20 time: 0.163450 Dec 15 16:26:31.715326 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 357/704] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:26:31 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1749 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:26:31.907592 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-1b5e1eee-4c0c-445b-a4f3-6209bb782eb6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:31.908197 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-1b5e1eee-4c0c-445b-a4f3-6209bb782eb6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:31.915387 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1b5e1eee-4c0c-445b-a4f3-6209bb782eb6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:31.916052 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1b5e1eee-4c0c-445b-a4f3-6209bb782eb6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:31.916761 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1b5e1eee-4c0c-445b-a4f3-6209bb782eb6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:31.917205 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1b5e1eee-4c0c-445b-a4f3-6209bb782eb6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:32.057176 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-1b5e1eee-4c0c-445b-a4f3-6209bb782eb6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:32.065855 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-1b5e1eee-4c0c-445b-a4f3-6209bb782eb6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82" status: 200 len: 1362 microversion: 2.1 time: 0.163848 Dec 15 16:26:32.066437 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 348/705] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:31 2021] GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:32.314081 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-182e533f-5358-4076-9233-6124ee0cf22c tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:32.314793 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-182e533f-5358-4076-9233-6124ee0cf22c tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:32.326333 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-182e533f-5358-4076-9233-6124ee0cf22c tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:32.327738 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-182e533f-5358-4076-9233-6124ee0cf22c tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:32.328970 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-182e533f-5358-4076-9233-6124ee0cf22c tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:32.329625 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-182e533f-5358-4076-9233-6124ee0cf22c tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:32.494045 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-182e533f-5358-4076-9233-6124ee0cf22c tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b554f95b7b4444ab70e9dabf8197de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fc732badb0488392694e6d6c67d5dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:32.502430 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-182e533f-5358-4076-9233-6124ee0cf22c tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d" status: 200 len: 1568 microversion: 2.1 time: 0.192064 Dec 15 16:26:32.503020 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 358/706] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:32 2021] GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d => generated 1568 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:32.733431 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-382b4091-fa2c-4045-93c6-1e85396e2714 req-6f716a18-40a5-4096-b1c4-a1fccd4db00d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aace7dfb-6043-406a-b7cf-4a633e026c82", "tag": "3ec4fed8-77d3-444b-b5eb-09f908b0f166"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:26:32.734327 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-2df9dac5-c318-40d2-a8c4-7d00dcb40382 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:32.735234 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:26:32.735234 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Dec 15 16:26:32.737233 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-2df9dac5-c318-40d2-a8c4-7d00dcb40382 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:32.743304 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2df9dac5-c318-40d2-a8c4-7d00dcb40382 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:32.743771 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2df9dac5-c318-40d2-a8c4-7d00dcb40382 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:32.744171 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-382b4091-fa2c-4045-93c6-1e85396e2714 req-6f716a18-40a5-4096-b1c4-a1fccd4db00d service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:32.744530 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2df9dac5-c318-40d2-a8c4-7d00dcb40382 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:32.744713 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-382b4091-fa2c-4045-93c6-1e85396e2714 req-6f716a18-40a5-4096-b1c4-a1fccd4db00d service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:32.744978 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2df9dac5-c318-40d2-a8c4-7d00dcb40382 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:32.781187 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-382b4091-fa2c-4045-93c6-1e85396e2714 req-6f716a18-40a5-4096-b1c4-a1fccd4db00d service nova] Creating event network-changed:3ec4fed8-77d3-444b-b5eb-09f908b0f166 for instance aace7dfb-6043-406a-b7cf-4a633e026c82 on hv-cinder-81268 Dec 15 16:26:32.787013 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-382b4091-fa2c-4045-93c6-1e85396e2714 req-6f716a18-40a5-4096-b1c4-a1fccd4db00d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128851 Dec 15 16:26:32.787932 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 349/707] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:26:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:26:32.889401 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-2df9dac5-c318-40d2-a8c4-7d00dcb40382 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:32.898291 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-2df9dac5-c318-40d2-a8c4-7d00dcb40382 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:32.899840 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-2df9dac5-c318-40d2-a8c4-7d00dcb40382 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:32.901099 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-2df9dac5-c318-40d2-a8c4-7d00dcb40382 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1749 microversion: 2.20 time: 0.171288 Dec 15 16:26:32.902147 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 359/708] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:26:32 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1749 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:26:33.084753 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-3891e6e5-264b-4641-8beb-efe511c2a830 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:33.085494 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-3891e6e5-264b-4641-8beb-efe511c2a830 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:33.092568 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3891e6e5-264b-4641-8beb-efe511c2a830 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:33.093012 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3891e6e5-264b-4641-8beb-efe511c2a830 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:33.093815 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3891e6e5-264b-4641-8beb-efe511c2a830 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:33.094247 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3891e6e5-264b-4641-8beb-efe511c2a830 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:33.242335 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-3891e6e5-264b-4641-8beb-efe511c2a830 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:33.251313 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-3891e6e5-264b-4641-8beb-efe511c2a830 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82" status: 200 len: 1362 microversion: 2.1 time: 0.171169 Dec 15 16:26:33.251925 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 350/709] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:33 2021] GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82 => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:33.520226 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-509bbb90-9eba-4347-ae18-15958adaeffd tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:33.520745 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-509bbb90-9eba-4347-ae18-15958adaeffd tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:33.527420 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-509bbb90-9eba-4347-ae18-15958adaeffd tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:33.527916 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-509bbb90-9eba-4347-ae18-15958adaeffd tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:33.528778 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-509bbb90-9eba-4347-ae18-15958adaeffd tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:33.529209 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-509bbb90-9eba-4347-ae18-15958adaeffd tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:33.669154 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-509bbb90-9eba-4347-ae18-15958adaeffd tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b554f95b7b4444ab70e9dabf8197de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fc732badb0488392694e6d6c67d5dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:33.677218 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-509bbb90-9eba-4347-ae18-15958adaeffd tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d" status: 200 len: 1568 microversion: 2.1 time: 0.160887 Dec 15 16:26:33.677798 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 360/710] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:33 2021] GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:33.921354 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-6de7e0bb-5469-4d8a-bc00-5a75fb9d0c67 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:33.921954 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-6de7e0bb-5469-4d8a-bc00-5a75fb9d0c67 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:33.928334 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6de7e0bb-5469-4d8a-bc00-5a75fb9d0c67 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:33.928906 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6de7e0bb-5469-4d8a-bc00-5a75fb9d0c67 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:33.929684 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6de7e0bb-5469-4d8a-bc00-5a75fb9d0c67 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:33.930113 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6de7e0bb-5469-4d8a-bc00-5a75fb9d0c67 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:34.072376 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-6de7e0bb-5469-4d8a-bc00-5a75fb9d0c67 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:34.081405 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-6de7e0bb-5469-4d8a-bc00-5a75fb9d0c67 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:34.082954 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-6de7e0bb-5469-4d8a-bc00-5a75fb9d0c67 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:34.084174 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-6de7e0bb-5469-4d8a-bc00-5a75fb9d0c67 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1751 microversion: 2.20 time: 0.167494 Dec 15 16:26:34.085041 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 351/711] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:26:33 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1751 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:26:34.271353 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-2aede993-0839-4d94-a262-3e8df64eca3e tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:34.273040 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-2aede993-0839-4d94-a262-3e8df64eca3e tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:34.280611 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2aede993-0839-4d94-a262-3e8df64eca3e tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:34.281638 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2aede993-0839-4d94-a262-3e8df64eca3e tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:34.282591 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2aede993-0839-4d94-a262-3e8df64eca3e tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:34.283031 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2aede993-0839-4d94-a262-3e8df64eca3e tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:34.421839 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-2aede993-0839-4d94-a262-3e8df64eca3e tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:34.430896 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-2aede993-0839-4d94-a262-3e8df64eca3e tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82" status: 200 len: 1362 microversion: 2.1 time: 0.163261 Dec 15 16:26:34.432142 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 361/712] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:34 2021] GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:34.694139 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-92ccab80-6680-4ec1-a553-691f4a06c29d tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:34.694811 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-92ccab80-6680-4ec1-a553-691f4a06c29d tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:34.701691 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-92ccab80-6680-4ec1-a553-691f4a06c29d tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:34.702478 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-92ccab80-6680-4ec1-a553-691f4a06c29d tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:34.703625 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-92ccab80-6680-4ec1-a553-691f4a06c29d tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:34.704325 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-92ccab80-6680-4ec1-a553-691f4a06c29d tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:34.852112 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-92ccab80-6680-4ec1-a553-691f4a06c29d tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b554f95b7b4444ab70e9dabf8197de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fc732badb0488392694e6d6c67d5dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:34.861272 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-92ccab80-6680-4ec1-a553-691f4a06c29d tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d" status: 200 len: 1568 microversion: 2.1 time: 0.170866 Dec 15 16:26:34.861850 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 352/713] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:34 2021] GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:35.103772 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0e7d1f0f-4e20-449e-887f-f482595dea3c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:35.104300 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-0e7d1f0f-4e20-449e-887f-f482595dea3c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:35.111018 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0e7d1f0f-4e20-449e-887f-f482595dea3c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:35.111488 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0e7d1f0f-4e20-449e-887f-f482595dea3c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:35.112284 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0e7d1f0f-4e20-449e-887f-f482595dea3c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:35.112713 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0e7d1f0f-4e20-449e-887f-f482595dea3c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:35.255579 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-0e7d1f0f-4e20-449e-887f-f482595dea3c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:35.264684 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-0e7d1f0f-4e20-449e-887f-f482595dea3c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:35.266187 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-0e7d1f0f-4e20-449e-887f-f482595dea3c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:35.267397 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0e7d1f0f-4e20-449e-887f-f482595dea3c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1807 microversion: 2.20 time: 0.167716 Dec 15 16:26:35.278507 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 362/714] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:26:35 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:26:35.453218 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-d75771a4-27b9-4eef-9bfc-f1503a6e83d9 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:35.453909 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-d75771a4-27b9-4eef-9bfc-f1503a6e83d9 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:35.460522 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d75771a4-27b9-4eef-9bfc-f1503a6e83d9 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:35.460955 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d75771a4-27b9-4eef-9bfc-f1503a6e83d9 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:35.461937 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d75771a4-27b9-4eef-9bfc-f1503a6e83d9 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:35.462530 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d75771a4-27b9-4eef-9bfc-f1503a6e83d9 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:35.697917 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-d75771a4-27b9-4eef-9bfc-f1503a6e83d9 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:35.707273 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-d75771a4-27b9-4eef-9bfc-f1503a6e83d9 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82" status: 200 len: 1362 microversion: 2.1 time: 0.262629 Dec 15 16:26:35.708171 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 353/715] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:35 2021] GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82 => generated 1362 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:35.877996 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ea680abf-f605-423a-82d5-8c8c33f87aac tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:35.878989 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ea680abf-f605-423a-82d5-8c8c33f87aac tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:35.885599 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ea680abf-f605-423a-82d5-8c8c33f87aac tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:35.886182 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ea680abf-f605-423a-82d5-8c8c33f87aac tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:35.887074 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ea680abf-f605-423a-82d5-8c8c33f87aac tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:35.887648 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ea680abf-f605-423a-82d5-8c8c33f87aac tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:36.138488 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ea680abf-f605-423a-82d5-8c8c33f87aac tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b554f95b7b4444ab70e9dabf8197de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fc732badb0488392694e6d6c67d5dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:36.150161 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ea680abf-f605-423a-82d5-8c8c33f87aac tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d" status: 200 len: 1568 microversion: 2.1 time: 0.275804 Dec 15 16:26:36.161265 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 363/716] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:35 2021] GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d => generated 1568 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:36.286085 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-65980ff5-6e5e-4d7a-9feb-d6e4da90a92f tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:36.286692 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-65980ff5-6e5e-4d7a-9feb-d6e4da90a92f tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:36.293105 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-65980ff5-6e5e-4d7a-9feb-d6e4da90a92f tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:36.293783 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-65980ff5-6e5e-4d7a-9feb-d6e4da90a92f tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:36.294695 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-65980ff5-6e5e-4d7a-9feb-d6e4da90a92f tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:36.295185 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-65980ff5-6e5e-4d7a-9feb-d6e4da90a92f tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:36.509637 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-65980ff5-6e5e-4d7a-9feb-d6e4da90a92f tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:36.520803 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-65980ff5-6e5e-4d7a-9feb-d6e4da90a92f tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:36.522679 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-65980ff5-6e5e-4d7a-9feb-d6e4da90a92f tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:36.524106 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-65980ff5-6e5e-4d7a-9feb-d6e4da90a92f tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1807 microversion: 2.20 time: 0.241848 Dec 15 16:26:36.535988 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 354/717] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:26:36 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1807 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:26:36.726383 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-2218cdee-ce7e-4516-8d86-84e60c8d433e tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:36.727828 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-2218cdee-ce7e-4516-8d86-84e60c8d433e tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:36.737614 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2218cdee-ce7e-4516-8d86-84e60c8d433e tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:36.738101 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2218cdee-ce7e-4516-8d86-84e60c8d433e tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:36.738983 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2218cdee-ce7e-4516-8d86-84e60c8d433e tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:36.746896 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2218cdee-ce7e-4516-8d86-84e60c8d433e tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:36.996389 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-2218cdee-ce7e-4516-8d86-84e60c8d433e tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:37.010228 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-2218cdee-ce7e-4516-8d86-84e60c8d433e tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82" status: 200 len: 1362 microversion: 2.1 time: 0.287093 Dec 15 16:26:37.027146 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 364/718] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:36 2021] GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82 => generated 1362 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:37.173664 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-fcca84f9-e6e8-41d8-9ffc-f929b695681f tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:37.177439 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-fcca84f9-e6e8-41d8-9ffc-f929b695681f tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:37.195574 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fcca84f9-e6e8-41d8-9ffc-f929b695681f tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:37.204320 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fcca84f9-e6e8-41d8-9ffc-f929b695681f tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:37.205395 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fcca84f9-e6e8-41d8-9ffc-f929b695681f tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:37.206015 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fcca84f9-e6e8-41d8-9ffc-f929b695681f tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:37.396240 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-fcca84f9-e6e8-41d8-9ffc-f929b695681f tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b554f95b7b4444ab70e9dabf8197de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fc732badb0488392694e6d6c67d5dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:37.405228 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-fcca84f9-e6e8-41d8-9ffc-f929b695681f tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d" status: 200 len: 1568 microversion: 2.1 time: 0.240026 Dec 15 16:26:37.405821 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 355/719] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:37 2021] GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d => generated 1568 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:37.542200 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-9418a8b8-395f-45ce-9b3d-bba6b66e52f1 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:37.542714 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-9418a8b8-395f-45ce-9b3d-bba6b66e52f1 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:37.549609 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9418a8b8-395f-45ce-9b3d-bba6b66e52f1 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:37.550137 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9418a8b8-395f-45ce-9b3d-bba6b66e52f1 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:37.550823 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9418a8b8-395f-45ce-9b3d-bba6b66e52f1 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:37.551251 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9418a8b8-395f-45ce-9b3d-bba6b66e52f1 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:37.703719 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-9418a8b8-395f-45ce-9b3d-bba6b66e52f1 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:37.713373 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-9418a8b8-395f-45ce-9b3d-bba6b66e52f1 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:37.715002 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-9418a8b8-395f-45ce-9b3d-bba6b66e52f1 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:37.716324 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-9418a8b8-395f-45ce-9b3d-bba6b66e52f1 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1807 microversion: 2.20 time: 0.177994 Dec 15 16:26:37.717018 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 365/720] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:26:37 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:26:38.034534 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-ada783fe-97ea-4a6b-bc56-dbc3cd4b9a87 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:38.035149 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-ada783fe-97ea-4a6b-bc56-dbc3cd4b9a87 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:38.041203 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ada783fe-97ea-4a6b-bc56-dbc3cd4b9a87 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:38.041649 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ada783fe-97ea-4a6b-bc56-dbc3cd4b9a87 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:38.042423 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ada783fe-97ea-4a6b-bc56-dbc3cd4b9a87 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:38.042854 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ada783fe-97ea-4a6b-bc56-dbc3cd4b9a87 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:38.221245 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-ada783fe-97ea-4a6b-bc56-dbc3cd4b9a87 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:38.222974 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-6017aedd-b8f7-4c4f-b2a8-be891bb3a978 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:38.223507 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-6017aedd-b8f7-4c4f-b2a8-be891bb3a978 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] [instance: b2c86622-4d3b-4750-9589-e485a89473cb] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:38.230917 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6017aedd-b8f7-4c4f-b2a8-be891bb3a978 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:38.231418 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6017aedd-b8f7-4c4f-b2a8-be891bb3a978 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:38.233050 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6017aedd-b8f7-4c4f-b2a8-be891bb3a978 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:38.233176 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6017aedd-b8f7-4c4f-b2a8-be891bb3a978 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:38.235759 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-ada783fe-97ea-4a6b-bc56-dbc3cd4b9a87 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82" status: 200 len: 1362 microversion: 2.1 time: 0.205040 Dec 15 16:26:38.236768 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 356/721] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:38 2021] GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82 => generated 1362 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:26:38.359246 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.objects.instance [None req-6017aedd-b8f7-4c4f-b2a8-be891bb3a978 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lazy-loading 'services' on Instance uuid b2c86622-4d3b-4750-9589-e485a89473cb {{(pid=116084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:26:38.427033 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-14a82a5d-98dc-4f54-b5ae-2951757115d1 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:38.428164 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-14a82a5d-98dc-4f54-b5ae-2951757115d1 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:38.438365 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-14a82a5d-98dc-4f54-b5ae-2951757115d1 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:38.439217 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-14a82a5d-98dc-4f54-b5ae-2951757115d1 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:38.440421 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-14a82a5d-98dc-4f54-b5ae-2951757115d1 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:38.444833 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-14a82a5d-98dc-4f54-b5ae-2951757115d1 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:38.486032 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-6017aedd-b8f7-4c4f-b2a8-be891bb3a978 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b2c86622-4d3b-4750-9589-e485a89473cb/os-volume_attachments/63f86b22-ef95-4fae-83f6-f9f4e5605d2a" status: 202 len: 0 microversion: 2.1 time: 0.264406 Dec 15 16:26:38.487740 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 366/722] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Dec 15 16:26:38 2021] DELETE /compute/v2.1/servers/b2c86622-4d3b-4750-9589-e485a89473cb/os-volume_attachments/63f86b22-ef95-4fae-83f6-f9f4e5605d2a => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:26:38.643012 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-bc56e8a6-f566-4391-8473-b2e844d6fe6f req-55fa64d0-15d8-4381-b579-3de093a67d05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aace7dfb-6043-406a-b7cf-4a633e026c82", "name": "network-vif-plugged", "status": "completed", "tag": "3ec4fed8-77d3-444b-b5eb-09f908b0f166"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:26:38.644678 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:26:38.644678 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:26:38.657702 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-bc56e8a6-f566-4391-8473-b2e844d6fe6f req-55fa64d0-15d8-4381-b579-3de093a67d05 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:38.660096 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-bc56e8a6-f566-4391-8473-b2e844d6fe6f req-55fa64d0-15d8-4381-b579-3de093a67d05 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:38.683221 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-bc56e8a6-f566-4391-8473-b2e844d6fe6f req-55fa64d0-15d8-4381-b579-3de093a67d05 service nova] Creating event network-vif-plugged:3ec4fed8-77d3-444b-b5eb-09f908b0f166 for instance aace7dfb-6043-406a-b7cf-4a633e026c82 on hv-cinder-81268 Dec 15 16:26:38.702430 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-bc56e8a6-f566-4391-8473-b2e844d6fe6f req-55fa64d0-15d8-4381-b579-3de093a67d05 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057855 Dec 15 16:26:38.703447 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 367/723] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:26:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:26:38.721420 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-14a82a5d-98dc-4f54-b5ae-2951757115d1 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b554f95b7b4444ab70e9dabf8197de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fc732badb0488392694e6d6c67d5dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:38.756226 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-59c0ff19-c04d-41e0-afa5-72eae36d9490 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:38.757926 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-59c0ff19-c04d-41e0-afa5-72eae36d9490 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:38.765067 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-14a82a5d-98dc-4f54-b5ae-2951757115d1 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d" status: 200 len: 1568 microversion: 2.1 time: 0.344868 Dec 15 16:26:38.768706 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 357/724] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:38 2021] GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d => generated 1568 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:38.773622 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-59c0ff19-c04d-41e0-afa5-72eae36d9490 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:38.775017 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-59c0ff19-c04d-41e0-afa5-72eae36d9490 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:38.776141 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-59c0ff19-c04d-41e0-afa5-72eae36d9490 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:38.778216 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-59c0ff19-c04d-41e0-afa5-72eae36d9490 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:38.938111 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-59c0ff19-c04d-41e0-afa5-72eae36d9490 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:38.947024 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-59c0ff19-c04d-41e0-afa5-72eae36d9490 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:38.948863 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-59c0ff19-c04d-41e0-afa5-72eae36d9490 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:38.950230 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-59c0ff19-c04d-41e0-afa5-72eae36d9490 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1807 microversion: 2.20 time: 0.218873 Dec 15 16:26:38.951052 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 368/725] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:26:38 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1807 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:26:39.255211 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-b3526e38-8f68-46fd-bfa0-6049a2134812 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:39.256430 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-b3526e38-8f68-46fd-bfa0-6049a2134812 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:39.265315 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b3526e38-8f68-46fd-bfa0-6049a2134812 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:39.265768 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b3526e38-8f68-46fd-bfa0-6049a2134812 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:39.266760 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b3526e38-8f68-46fd-bfa0-6049a2134812 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:39.267202 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b3526e38-8f68-46fd-bfa0-6049a2134812 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:39.428855 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-b3526e38-8f68-46fd-bfa0-6049a2134812 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:39.438429 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-b3526e38-8f68-46fd-bfa0-6049a2134812 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82" status: 200 len: 1362 microversion: 2.1 time: 0.189514 Dec 15 16:26:39.440359 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 358/726] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:39 2021] GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82 => generated 1362 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:39.785801 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-4b11cf89-596b-4717-89fe-091429790ef3 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:39.787882 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-4b11cf89-596b-4717-89fe-091429790ef3 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:39.797075 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4b11cf89-596b-4717-89fe-091429790ef3 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:39.797798 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4b11cf89-596b-4717-89fe-091429790ef3 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:39.799063 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4b11cf89-596b-4717-89fe-091429790ef3 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:39.800474 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4b11cf89-596b-4717-89fe-091429790ef3 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:39.968606 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-4b11cf89-596b-4717-89fe-091429790ef3 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b554f95b7b4444ab70e9dabf8197de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fc732badb0488392694e6d6c67d5dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:39.970709 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-50643c05-4d58-499f-ae3f-14e77d37608e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:39.971416 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-50643c05-4d58-499f-ae3f-14e77d37608e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:39.976378 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-4b11cf89-596b-4717-89fe-091429790ef3 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d" status: 200 len: 1568 microversion: 2.1 time: 0.194396 Dec 15 16:26:39.977214 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 369/727] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:39 2021] GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d => generated 1568 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:39.978446 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-50643c05-4d58-499f-ae3f-14e77d37608e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:39.979025 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-50643c05-4d58-499f-ae3f-14e77d37608e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:39.979938 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-50643c05-4d58-499f-ae3f-14e77d37608e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:39.980618 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-50643c05-4d58-499f-ae3f-14e77d37608e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:40.144449 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-50643c05-4d58-499f-ae3f-14e77d37608e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:40.155557 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-50643c05-4d58-499f-ae3f-14e77d37608e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:40.157733 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-50643c05-4d58-499f-ae3f-14e77d37608e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:40.159244 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-50643c05-4d58-499f-ae3f-14e77d37608e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1807 microversion: 2.20 time: 0.193767 Dec 15 16:26:40.159838 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 359/728] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:26:39 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1807 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:26:40.458232 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c51b13ff-e501-44b1-926a-a0fdb84871e7 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:40.459580 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c51b13ff-e501-44b1-926a-a0fdb84871e7 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:40.467154 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c51b13ff-e501-44b1-926a-a0fdb84871e7 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:40.467927 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c51b13ff-e501-44b1-926a-a0fdb84871e7 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:40.468908 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c51b13ff-e501-44b1-926a-a0fdb84871e7 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:40.469720 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c51b13ff-e501-44b1-926a-a0fdb84871e7 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:40.690274 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-c51b13ff-e501-44b1-926a-a0fdb84871e7 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:40.700443 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c51b13ff-e501-44b1-926a-a0fdb84871e7 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82" status: 200 len: 1362 microversion: 2.1 time: 0.247654 Dec 15 16:26:40.710939 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 370/729] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:40 2021] GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82 => generated 1362 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:26:40.998919 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-c78852ce-a371-4a58-8cff-610acb754335 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:41.000261 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-c78852ce-a371-4a58-8cff-610acb754335 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:41.007544 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c78852ce-a371-4a58-8cff-610acb754335 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:41.007995 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c78852ce-a371-4a58-8cff-610acb754335 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:41.008801 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c78852ce-a371-4a58-8cff-610acb754335 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:41.009399 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c78852ce-a371-4a58-8cff-610acb754335 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:41.163238 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-c78852ce-a371-4a58-8cff-610acb754335 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b554f95b7b4444ab70e9dabf8197de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fc732badb0488392694e6d6c67d5dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:41.171258 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-c78852ce-a371-4a58-8cff-610acb754335 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d" status: 200 len: 1568 microversion: 2.1 time: 0.177140 Dec 15 16:26:41.175195 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 360/730] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:40 2021] GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:26:41.178483 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-4e43c02f-3ab7-4966-8853-8272bb4d6812 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:41.179184 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-4e43c02f-3ab7-4966-8853-8272bb4d6812 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:41.186729 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4e43c02f-3ab7-4966-8853-8272bb4d6812 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:41.187291 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4e43c02f-3ab7-4966-8853-8272bb4d6812 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:41.188394 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4e43c02f-3ab7-4966-8853-8272bb4d6812 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:41.188837 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4e43c02f-3ab7-4966-8853-8272bb4d6812 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:41.341837 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-4e43c02f-3ab7-4966-8853-8272bb4d6812 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:41.352226 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-4e43c02f-3ab7-4966-8853-8272bb4d6812 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:41.353744 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-4e43c02f-3ab7-4966-8853-8272bb4d6812 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:41.354899 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-4e43c02f-3ab7-4966-8853-8272bb4d6812 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1807 microversion: 2.20 time: 0.180579 Dec 15 16:26:41.356049 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 371/731] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:26:41 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1807 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:26:41.724152 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-6a27d3f8-11ac-4df9-b760-49b3c84cf48d tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:41.724750 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-6a27d3f8-11ac-4df9-b760-49b3c84cf48d tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:41.735024 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6a27d3f8-11ac-4df9-b760-49b3c84cf48d tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:41.735505 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6a27d3f8-11ac-4df9-b760-49b3c84cf48d tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:41.736297 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6a27d3f8-11ac-4df9-b760-49b3c84cf48d tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:41.736970 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6a27d3f8-11ac-4df9-b760-49b3c84cf48d tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:41.920719 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-6a27d3f8-11ac-4df9-b760-49b3c84cf48d tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:41.929819 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-6a27d3f8-11ac-4df9-b760-49b3c84cf48d tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82" status: 200 len: 1362 microversion: 2.1 time: 0.214610 Dec 15 16:26:41.947424 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 361/732] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:41 2021] GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82 => generated 1362 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:42.192228 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-a58cd072-330e-4c53-b67e-a909897c9a4f tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:42.192875 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-a58cd072-330e-4c53-b67e-a909897c9a4f tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:42.199979 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a58cd072-330e-4c53-b67e-a909897c9a4f tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:42.200419 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a58cd072-330e-4c53-b67e-a909897c9a4f tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:42.201272 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a58cd072-330e-4c53-b67e-a909897c9a4f tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:42.201705 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a58cd072-330e-4c53-b67e-a909897c9a4f tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:42.344301 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-a58cd072-330e-4c53-b67e-a909897c9a4f tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b554f95b7b4444ab70e9dabf8197de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fc732badb0488392694e6d6c67d5dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:42.354319 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-a58cd072-330e-4c53-b67e-a909897c9a4f tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d" status: 200 len: 1568 microversion: 2.1 time: 0.165772 Dec 15 16:26:42.366576 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 372/733] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:42 2021] GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:42.380312 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-44e1734b-32b3-4de5-b77b-614f5cffd126 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:42.381821 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-44e1734b-32b3-4de5-b77b-614f5cffd126 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:42.390446 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-44e1734b-32b3-4de5-b77b-614f5cffd126 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:42.391315 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-44e1734b-32b3-4de5-b77b-614f5cffd126 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:42.392554 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-44e1734b-32b3-4de5-b77b-614f5cffd126 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:42.393312 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-44e1734b-32b3-4de5-b77b-614f5cffd126 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:42.537862 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-44e1734b-32b3-4de5-b77b-614f5cffd126 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:42.548097 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-44e1734b-32b3-4de5-b77b-614f5cffd126 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:42.549987 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-44e1734b-32b3-4de5-b77b-614f5cffd126 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:42.551170 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-44e1734b-32b3-4de5-b77b-614f5cffd126 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1807 microversion: 2.20 time: 0.175362 Dec 15 16:26:42.552136 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 362/734] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:26:42 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:26:42.952206 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-892f8614-fff1-42c0-a2e0-9e9428d7f41e tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:42.953068 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-892f8614-fff1-42c0-a2e0-9e9428d7f41e tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:42.959923 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-892f8614-fff1-42c0-a2e0-9e9428d7f41e tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:42.960400 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-892f8614-fff1-42c0-a2e0-9e9428d7f41e tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:42.961194 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-892f8614-fff1-42c0-a2e0-9e9428d7f41e tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:42.961628 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-892f8614-fff1-42c0-a2e0-9e9428d7f41e tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:43.114514 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-892f8614-fff1-42c0-a2e0-9e9428d7f41e tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:43.125118 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-892f8614-fff1-42c0-a2e0-9e9428d7f41e tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82" status: 200 len: 1362 microversion: 2.1 time: 0.176690 Dec 15 16:26:43.125697 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 373/735] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:42 2021] GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82 => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:43.375571 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-5b318700-61ab-4264-adcc-b26ee855d49e tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:43.376789 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-5b318700-61ab-4264-adcc-b26ee855d49e tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:43.387080 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5b318700-61ab-4264-adcc-b26ee855d49e tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:43.387862 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5b318700-61ab-4264-adcc-b26ee855d49e tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:43.388379 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5b318700-61ab-4264-adcc-b26ee855d49e tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:43.388819 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5b318700-61ab-4264-adcc-b26ee855d49e tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:43.548507 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-5b318700-61ab-4264-adcc-b26ee855d49e tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b554f95b7b4444ab70e9dabf8197de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fc732badb0488392694e6d6c67d5dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:43.556290 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-5b318700-61ab-4264-adcc-b26ee855d49e tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d" status: 200 len: 1568 microversion: 2.1 time: 0.186016 Dec 15 16:26:43.557184 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 363/736] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:43 2021] GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:43.573234 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-dfe0d27d-1775-4e9c-8a9c-c0a392d63795 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:43.573812 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-dfe0d27d-1775-4e9c-8a9c-c0a392d63795 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:43.580552 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dfe0d27d-1775-4e9c-8a9c-c0a392d63795 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:43.580996 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dfe0d27d-1775-4e9c-8a9c-c0a392d63795 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:43.581777 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dfe0d27d-1775-4e9c-8a9c-c0a392d63795 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:43.582196 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dfe0d27d-1775-4e9c-8a9c-c0a392d63795 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:43.965475 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-dfe0d27d-1775-4e9c-8a9c-c0a392d63795 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:43.973982 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-dfe0d27d-1775-4e9c-8a9c-c0a392d63795 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:43.975499 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-dfe0d27d-1775-4e9c-8a9c-c0a392d63795 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:43.976666 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-dfe0d27d-1775-4e9c-8a9c-c0a392d63795 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1807 microversion: 2.20 time: 0.407689 Dec 15 16:26:43.977233 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 374/737] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:26:43 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1807 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:26:44.152220 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-c1fe1cbf-d648-494b-9044-809d7a011dc7 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:44.152933 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-c1fe1cbf-d648-494b-9044-809d7a011dc7 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:44.162003 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c1fe1cbf-d648-494b-9044-809d7a011dc7 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:44.162565 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c1fe1cbf-d648-494b-9044-809d7a011dc7 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:44.163695 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c1fe1cbf-d648-494b-9044-809d7a011dc7 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:44.164228 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c1fe1cbf-d648-494b-9044-809d7a011dc7 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:44.310918 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-c1fe1cbf-d648-494b-9044-809d7a011dc7 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:44.319278 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-c1fe1cbf-d648-494b-9044-809d7a011dc7 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82" status: 200 len: 1362 microversion: 2.1 time: 0.173213 Dec 15 16:26:44.320312 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 364/738] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:44 2021] GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:44.574573 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-5da14049-2817-4d30-8bc9-5a545673aafa tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:44.575265 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-5da14049-2817-4d30-8bc9-5a545673aafa tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:44.582227 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5da14049-2817-4d30-8bc9-5a545673aafa tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:44.582695 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5da14049-2817-4d30-8bc9-5a545673aafa tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:44.583538 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5da14049-2817-4d30-8bc9-5a545673aafa tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:44.584011 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5da14049-2817-4d30-8bc9-5a545673aafa tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:44.728118 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-5da14049-2817-4d30-8bc9-5a545673aafa tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b554f95b7b4444ab70e9dabf8197de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fc732badb0488392694e6d6c67d5dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:44.736657 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-5da14049-2817-4d30-8bc9-5a545673aafa tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d" status: 200 len: 1568 microversion: 2.1 time: 0.165780 Dec 15 16:26:44.737351 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 375/739] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:44 2021] GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:44.996852 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-799f3d81-865a-45c5-adb9-dd676b04b804 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:44.997483 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-799f3d81-865a-45c5-adb9-dd676b04b804 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:45.004837 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-799f3d81-865a-45c5-adb9-dd676b04b804 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:45.005334 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-799f3d81-865a-45c5-adb9-dd676b04b804 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:45.006158 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-799f3d81-865a-45c5-adb9-dd676b04b804 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:45.006659 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-799f3d81-865a-45c5-adb9-dd676b04b804 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:45.167038 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-799f3d81-865a-45c5-adb9-dd676b04b804 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:45.178061 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-799f3d81-865a-45c5-adb9-dd676b04b804 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:45.179575 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-799f3d81-865a-45c5-adb9-dd676b04b804 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:45.180727 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-799f3d81-865a-45c5-adb9-dd676b04b804 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1807 microversion: 2.20 time: 0.187822 Dec 15 16:26:45.181280 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 365/740] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:26:44 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1807 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:26:45.339261 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f24eed0c-7d91-4a87-bcbf-45467e6684aa tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:45.340154 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f24eed0c-7d91-4a87-bcbf-45467e6684aa tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:45.347498 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f24eed0c-7d91-4a87-bcbf-45467e6684aa tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:45.347955 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f24eed0c-7d91-4a87-bcbf-45467e6684aa tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:45.348737 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f24eed0c-7d91-4a87-bcbf-45467e6684aa tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:45.349172 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f24eed0c-7d91-4a87-bcbf-45467e6684aa tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:45.491302 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f24eed0c-7d91-4a87-bcbf-45467e6684aa tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:45.500346 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f24eed0c-7d91-4a87-bcbf-45467e6684aa tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82" status: 200 len: 1362 microversion: 2.1 time: 0.166862 Dec 15 16:26:45.501607 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 376/741] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:45 2021] GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:45.754561 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-8d785f30-2ae2-4830-9a0a-2099136c34f0 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:45.755102 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-8d785f30-2ae2-4830-9a0a-2099136c34f0 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:45.761611 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8d785f30-2ae2-4830-9a0a-2099136c34f0 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:45.762073 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8d785f30-2ae2-4830-9a0a-2099136c34f0 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:45.762883 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8d785f30-2ae2-4830-9a0a-2099136c34f0 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:45.763319 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8d785f30-2ae2-4830-9a0a-2099136c34f0 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:45.923792 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-8d785f30-2ae2-4830-9a0a-2099136c34f0 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b554f95b7b4444ab70e9dabf8197de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fc732badb0488392694e6d6c67d5dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:45.932225 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-8d785f30-2ae2-4830-9a0a-2099136c34f0 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d" status: 200 len: 1568 microversion: 2.1 time: 0.181595 Dec 15 16:26:45.932846 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 366/742] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:45 2021] GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:26:46.199245 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b499f5db-aa73-456b-8f91-0d345264a80b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:46.200020 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b499f5db-aa73-456b-8f91-0d345264a80b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:46.206847 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b499f5db-aa73-456b-8f91-0d345264a80b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:46.207421 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b499f5db-aa73-456b-8f91-0d345264a80b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:46.208291 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b499f5db-aa73-456b-8f91-0d345264a80b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:46.208796 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b499f5db-aa73-456b-8f91-0d345264a80b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:46.401454 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b499f5db-aa73-456b-8f91-0d345264a80b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:46.410370 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b499f5db-aa73-456b-8f91-0d345264a80b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:46.412283 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b499f5db-aa73-456b-8f91-0d345264a80b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:46.413526 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b499f5db-aa73-456b-8f91-0d345264a80b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1807 microversion: 2.20 time: 0.218112 Dec 15 16:26:46.414177 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 377/743] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:26:46 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1807 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:26:46.518499 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-1c9c0d4b-0a56-4906-b3f1-5488d4c680f7 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:46.519137 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-1c9c0d4b-0a56-4906-b3f1-5488d4c680f7 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:46.526041 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1c9c0d4b-0a56-4906-b3f1-5488d4c680f7 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:46.526489 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1c9c0d4b-0a56-4906-b3f1-5488d4c680f7 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:46.527285 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1c9c0d4b-0a56-4906-b3f1-5488d4c680f7 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:46.527765 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1c9c0d4b-0a56-4906-b3f1-5488d4c680f7 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:46.677501 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-1c9c0d4b-0a56-4906-b3f1-5488d4c680f7 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:46.685103 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-1c9c0d4b-0a56-4906-b3f1-5488d4c680f7 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82" status: 200 len: 1362 microversion: 2.1 time: 0.170853 Dec 15 16:26:46.685677 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 367/744] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:46 2021] GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:46.950784 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ee42201d-bc3a-423a-8f12-1dbcd3c4ca9d tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:46.951027 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ee42201d-bc3a-423a-8f12-1dbcd3c4ca9d tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:46.957700 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ee42201d-bc3a-423a-8f12-1dbcd3c4ca9d tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:46.958123 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ee42201d-bc3a-423a-8f12-1dbcd3c4ca9d tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:46.959104 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ee42201d-bc3a-423a-8f12-1dbcd3c4ca9d tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:46.959560 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ee42201d-bc3a-423a-8f12-1dbcd3c4ca9d tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:47.111637 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ee42201d-bc3a-423a-8f12-1dbcd3c4ca9d tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b554f95b7b4444ab70e9dabf8197de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fc732badb0488392694e6d6c67d5dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:47.122533 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ee42201d-bc3a-423a-8f12-1dbcd3c4ca9d tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d" status: 200 len: 1568 microversion: 2.1 time: 0.175523 Dec 15 16:26:47.123396 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 378/745] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:46 2021] GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:47.433453 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-c8e9ffcd-38ee-4f4e-a992-19cae3f423cf tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:47.434577 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-c8e9ffcd-38ee-4f4e-a992-19cae3f423cf tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:47.442319 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c8e9ffcd-38ee-4f4e-a992-19cae3f423cf tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:47.442903 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c8e9ffcd-38ee-4f4e-a992-19cae3f423cf tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:47.444348 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c8e9ffcd-38ee-4f4e-a992-19cae3f423cf tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:47.445158 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c8e9ffcd-38ee-4f4e-a992-19cae3f423cf tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:47.581950 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-c8e9ffcd-38ee-4f4e-a992-19cae3f423cf tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:47.591062 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-c8e9ffcd-38ee-4f4e-a992-19cae3f423cf tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:47.592597 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-c8e9ffcd-38ee-4f4e-a992-19cae3f423cf tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:47.593815 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-c8e9ffcd-38ee-4f4e-a992-19cae3f423cf tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1807 microversion: 2.20 time: 0.164534 Dec 15 16:26:47.594382 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 368/746] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:26:47 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:26:47.702589 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-124d701e-e23d-4cda-beb2-c9a68e9e2af0 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:47.703250 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-124d701e-e23d-4cda-beb2-c9a68e9e2af0 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:47.711606 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-124d701e-e23d-4cda-beb2-c9a68e9e2af0 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:47.712183 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-124d701e-e23d-4cda-beb2-c9a68e9e2af0 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:47.713388 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-124d701e-e23d-4cda-beb2-c9a68e9e2af0 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:47.713966 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-124d701e-e23d-4cda-beb2-c9a68e9e2af0 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:47.872813 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-124d701e-e23d-4cda-beb2-c9a68e9e2af0 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:47.882374 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-124d701e-e23d-4cda-beb2-c9a68e9e2af0 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82" status: 200 len: 1362 microversion: 2.1 time: 0.183364 Dec 15 16:26:47.883606 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 379/747] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:47 2021] GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82 => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:48.147189 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-8285cebf-d67b-437e-b9b5-0ef6ecfec60e tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:48.147718 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-8285cebf-d67b-437e-b9b5-0ef6ecfec60e tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:48.153968 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8285cebf-d67b-437e-b9b5-0ef6ecfec60e tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:48.154417 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8285cebf-d67b-437e-b9b5-0ef6ecfec60e tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:48.155155 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8285cebf-d67b-437e-b9b5-0ef6ecfec60e tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:48.155765 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8285cebf-d67b-437e-b9b5-0ef6ecfec60e tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:48.309317 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-8285cebf-d67b-437e-b9b5-0ef6ecfec60e tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b554f95b7b4444ab70e9dabf8197de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fc732badb0488392694e6d6c67d5dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:48.317305 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-8285cebf-d67b-437e-b9b5-0ef6ecfec60e tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d" status: 200 len: 1568 microversion: 2.1 time: 0.173926 Dec 15 16:26:48.317962 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 369/748] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:48 2021] GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:48.613079 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-a9474b60-fd50-4ac4-abb7-c11758807a16 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:48.613700 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-a9474b60-fd50-4ac4-abb7-c11758807a16 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:48.620757 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a9474b60-fd50-4ac4-abb7-c11758807a16 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:48.621198 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a9474b60-fd50-4ac4-abb7-c11758807a16 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:48.621972 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a9474b60-fd50-4ac4-abb7-c11758807a16 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:48.622397 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a9474b60-fd50-4ac4-abb7-c11758807a16 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:48.771643 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-a9474b60-fd50-4ac4-abb7-c11758807a16 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:48.784510 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-a9474b60-fd50-4ac4-abb7-c11758807a16 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:48.786430 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-a9474b60-fd50-4ac4-abb7-c11758807a16 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:48.788249 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-a9474b60-fd50-4ac4-abb7-c11758807a16 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1807 microversion: 2.20 time: 0.178806 Dec 15 16:26:48.788964 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 380/749] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:26:48 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:26:48.900412 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-d368e437-e2a2-4aa2-8256-4c54c156c635 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:48.901010 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-d368e437-e2a2-4aa2-8256-4c54c156c635 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:48.907820 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d368e437-e2a2-4aa2-8256-4c54c156c635 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:48.908280 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d368e437-e2a2-4aa2-8256-4c54c156c635 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:48.909062 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d368e437-e2a2-4aa2-8256-4c54c156c635 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:48.909497 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d368e437-e2a2-4aa2-8256-4c54c156c635 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:49.054090 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-d368e437-e2a2-4aa2-8256-4c54c156c635 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:49.062799 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-d368e437-e2a2-4aa2-8256-4c54c156c635 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82" status: 200 len: 1362 microversion: 2.1 time: 0.166137 Dec 15 16:26:49.063411 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 370/750] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:48 2021] GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:49.335281 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-930f9d7f-792c-4643-b63b-7a57aa1878f1 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:49.335921 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-930f9d7f-792c-4643-b63b-7a57aa1878f1 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:49.342441 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-930f9d7f-792c-4643-b63b-7a57aa1878f1 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:49.342887 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-930f9d7f-792c-4643-b63b-7a57aa1878f1 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:49.343771 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-930f9d7f-792c-4643-b63b-7a57aa1878f1 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:49.344255 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-930f9d7f-792c-4643-b63b-7a57aa1878f1 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:49.507604 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-930f9d7f-792c-4643-b63b-7a57aa1878f1 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b554f95b7b4444ab70e9dabf8197de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fc732badb0488392694e6d6c67d5dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:49.515142 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-930f9d7f-792c-4643-b63b-7a57aa1878f1 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d" status: 200 len: 1568 microversion: 2.1 time: 0.183612 Dec 15 16:26:49.519612 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 381/751] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:49 2021] GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d => generated 1568 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:49.812746 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-3e992fec-779a-4474-953d-f8d0c8be9ef0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:49.813540 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-3e992fec-779a-4474-953d-f8d0c8be9ef0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:49.820516 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3e992fec-779a-4474-953d-f8d0c8be9ef0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:49.820960 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3e992fec-779a-4474-953d-f8d0c8be9ef0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:49.821725 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3e992fec-779a-4474-953d-f8d0c8be9ef0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:49.822157 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3e992fec-779a-4474-953d-f8d0c8be9ef0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:49.968987 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-3e992fec-779a-4474-953d-f8d0c8be9ef0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:49.978204 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-3e992fec-779a-4474-953d-f8d0c8be9ef0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:49.979736 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-3e992fec-779a-4474-953d-f8d0c8be9ef0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:49.981009 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-3e992fec-779a-4474-953d-f8d0c8be9ef0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1807 microversion: 2.20 time: 0.174573 Dec 15 16:26:49.985534 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 371/752] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:26:49 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:26:50.086048 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ebc61c2f-2dbe-48d9-9c2e-b7912473a892 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:50.086693 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ebc61c2f-2dbe-48d9-9c2e-b7912473a892 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:50.096689 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ebc61c2f-2dbe-48d9-9c2e-b7912473a892 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:50.097369 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ebc61c2f-2dbe-48d9-9c2e-b7912473a892 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:50.098573 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ebc61c2f-2dbe-48d9-9c2e-b7912473a892 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:50.099214 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ebc61c2f-2dbe-48d9-9c2e-b7912473a892 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:50.253329 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ebc61c2f-2dbe-48d9-9c2e-b7912473a892 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:50.260980 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ebc61c2f-2dbe-48d9-9c2e-b7912473a892 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82" status: 200 len: 1362 microversion: 2.1 time: 0.179275 Dec 15 16:26:50.261567 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 382/753] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:50 2021] GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82 => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:50.533105 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-f429fefa-99ef-4643-b474-a5da11b479ef tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:50.533712 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-f429fefa-99ef-4643-b474-a5da11b479ef tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:50.539711 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f429fefa-99ef-4643-b474-a5da11b479ef tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:50.540164 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f429fefa-99ef-4643-b474-a5da11b479ef tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:50.540948 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f429fefa-99ef-4643-b474-a5da11b479ef tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:50.541379 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f429fefa-99ef-4643-b474-a5da11b479ef tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:50.688241 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-f429fefa-99ef-4643-b474-a5da11b479ef tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b554f95b7b4444ab70e9dabf8197de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fc732badb0488392694e6d6c67d5dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:50.695948 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-f429fefa-99ef-4643-b474-a5da11b479ef tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d" status: 200 len: 1568 microversion: 2.1 time: 0.166840 Dec 15 16:26:50.696534 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 372/754] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:50 2021] GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:51.001933 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e4f59116-c67c-4bf4-9af2-32b07d644a96 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:51.002511 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e4f59116-c67c-4bf4-9af2-32b07d644a96 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:51.011330 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e4f59116-c67c-4bf4-9af2-32b07d644a96 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:51.011965 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e4f59116-c67c-4bf4-9af2-32b07d644a96 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:51.013168 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e4f59116-c67c-4bf4-9af2-32b07d644a96 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:51.013743 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e4f59116-c67c-4bf4-9af2-32b07d644a96 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:51.169437 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e4f59116-c67c-4bf4-9af2-32b07d644a96 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:51.179250 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e4f59116-c67c-4bf4-9af2-32b07d644a96 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:51.180775 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e4f59116-c67c-4bf4-9af2-32b07d644a96 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:51.181937 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e4f59116-c67c-4bf4-9af2-32b07d644a96 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1807 microversion: 2.20 time: 0.184758 Dec 15 16:26:51.182494 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 383/755] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:26:50 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1807 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:26:51.278011 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-330a44e6-2d2c-436d-b342-e70131f41658 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:51.278645 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-330a44e6-2d2c-436d-b342-e70131f41658 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:51.285721 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-330a44e6-2d2c-436d-b342-e70131f41658 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:51.286166 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-330a44e6-2d2c-436d-b342-e70131f41658 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:51.286942 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-330a44e6-2d2c-436d-b342-e70131f41658 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:51.287384 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-330a44e6-2d2c-436d-b342-e70131f41658 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:51.300574 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d633c4a1-e1eb-4483-b7f8-efd901eec525 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:51.301067 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d633c4a1-e1eb-4483-b7f8-efd901eec525 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] [instance: b2c86622-4d3b-4750-9589-e485a89473cb] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:51.307461 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d633c4a1-e1eb-4483-b7f8-efd901eec525 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:51.307916 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d633c4a1-e1eb-4483-b7f8-efd901eec525 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:51.308747 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d633c4a1-e1eb-4483-b7f8-efd901eec525 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:51.309218 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d633c4a1-e1eb-4483-b7f8-efd901eec525 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:51.338516 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d633c4a1-e1eb-4483-b7f8-efd901eec525 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] [instance: b2c86622-4d3b-4750-9589-e485a89473cb] Going to try to terminate instance {{(pid=116084) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:26:51.417441 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d633c4a1-e1eb-4483-b7f8-efd901eec525 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b2c86622-4d3b-4750-9589-e485a89473cb" status: 204 len: 0 microversion: 2.1 time: 0.120469 Dec 15 16:26:51.418057 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 384/756] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Dec 15 16:26:51 2021] DELETE /compute/v2.1/servers/b2c86622-4d3b-4750-9589-e485a89473cb => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:26:51.427265 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f7858bfa-3e93-4385-9e3f-6a94ab6310ee tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:51.427889 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-330a44e6-2d2c-436d-b342-e70131f41658 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:51.428038 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f7858bfa-3e93-4385-9e3f-6a94ab6310ee tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] [instance: b2c86622-4d3b-4750-9589-e485a89473cb] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:51.434397 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f7858bfa-3e93-4385-9e3f-6a94ab6310ee tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:51.434848 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f7858bfa-3e93-4385-9e3f-6a94ab6310ee tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:51.435665 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f7858bfa-3e93-4385-9e3f-6a94ab6310ee tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:51.435775 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-330a44e6-2d2c-436d-b342-e70131f41658 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82" status: 200 len: 1362 microversion: 2.1 time: 0.161257 Dec 15 16:26:51.436102 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f7858bfa-3e93-4385-9e3f-6a94ab6310ee tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:51.436552 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 373/757] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:51 2021] GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:51.583909 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f7858bfa-3e93-4385-9e3f-6a94ab6310ee tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b8a0a1adc54ff4abafe90692d10543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f435a136a5e44f89a0b09d4ec7427b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:51.592177 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f7858bfa-3e93-4385-9e3f-6a94ab6310ee tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] 10.222.0.60 "GET /compute/v2.1/servers/b2c86622-4d3b-4750-9589-e485a89473cb" status: 200 len: 1512 microversion: 2.1 time: 0.169132 Dec 15 16:26:51.592750 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 385/758] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:51 2021] GET /compute/v2.1/servers/b2c86622-4d3b-4750-9589-e485a89473cb => generated 1512 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:51.713424 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-bfbc6906-45d6-4dce-9afd-9bd77aefc251 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:51.714008 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-bfbc6906-45d6-4dce-9afd-9bd77aefc251 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:51.720695 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bfbc6906-45d6-4dce-9afd-9bd77aefc251 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:51.721149 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bfbc6906-45d6-4dce-9afd-9bd77aefc251 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:51.721889 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bfbc6906-45d6-4dce-9afd-9bd77aefc251 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:51.722353 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bfbc6906-45d6-4dce-9afd-9bd77aefc251 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:51.877211 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-bfbc6906-45d6-4dce-9afd-9bd77aefc251 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b554f95b7b4444ab70e9dabf8197de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fc732badb0488392694e6d6c67d5dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:51.886134 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-bfbc6906-45d6-4dce-9afd-9bd77aefc251 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d" status: 200 len: 1568 microversion: 2.1 time: 0.176366 Dec 15 16:26:51.886723 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 374/759] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:51 2021] GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:52.202093 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-fb1254f8-c0f0-4493-a740-f88032a98573 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:52.203030 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-fb1254f8-c0f0-4493-a740-f88032a98573 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:52.212804 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fb1254f8-c0f0-4493-a740-f88032a98573 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:52.213369 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fb1254f8-c0f0-4493-a740-f88032a98573 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:52.214533 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fb1254f8-c0f0-4493-a740-f88032a98573 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:52.215142 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-fb1254f8-c0f0-4493-a740-f88032a98573 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:52.357449 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-fb1254f8-c0f0-4493-a740-f88032a98573 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:52.366904 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-fb1254f8-c0f0-4493-a740-f88032a98573 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:52.368483 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-fb1254f8-c0f0-4493-a740-f88032a98573 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:52.369670 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-fb1254f8-c0f0-4493-a740-f88032a98573 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1807 microversion: 2.20 time: 0.172744 Dec 15 16:26:52.370230 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 386/760] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:26:52 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:26:52.454239 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-ad1a8f2a-9213-4245-ac2b-93197602f75f tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:52.454862 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-ad1a8f2a-9213-4245-ac2b-93197602f75f tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:52.461737 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ad1a8f2a-9213-4245-ac2b-93197602f75f tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:52.462194 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ad1a8f2a-9213-4245-ac2b-93197602f75f tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:52.462986 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ad1a8f2a-9213-4245-ac2b-93197602f75f tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:52.463454 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ad1a8f2a-9213-4245-ac2b-93197602f75f tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:52.610283 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-ad1a8f2a-9213-4245-ac2b-93197602f75f tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:52.616356 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-95e039ab-a38f-4011-a675-ec7011887c5d tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:52.616966 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-95e039ab-a38f-4011-a675-ec7011887c5d tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] [instance: b2c86622-4d3b-4750-9589-e485a89473cb] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:52.618287 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-ad1a8f2a-9213-4245-ac2b-93197602f75f tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82" status: 200 len: 1362 microversion: 2.1 time: 0.168374 Dec 15 16:26:52.618859 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 375/761] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:52 2021] GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:52.623086 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-95e039ab-a38f-4011-a675-ec7011887c5d tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:52.623577 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-95e039ab-a38f-4011-a675-ec7011887c5d tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:52.624397 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-95e039ab-a38f-4011-a675-ec7011887c5d tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:52.624835 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-95e039ab-a38f-4011-a675-ec7011887c5d tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:52.773106 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-95e039ab-a38f-4011-a675-ec7011887c5d tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b8a0a1adc54ff4abafe90692d10543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f435a136a5e44f89a0b09d4ec7427b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:52.781020 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-95e039ab-a38f-4011-a675-ec7011887c5d tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] 10.222.0.60 "GET /compute/v2.1/servers/b2c86622-4d3b-4750-9589-e485a89473cb" status: 200 len: 1512 microversion: 2.1 time: 0.168313 Dec 15 16:26:52.782050 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 387/762] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:52 2021] GET /compute/v2.1/servers/b2c86622-4d3b-4750-9589-e485a89473cb => generated 1512 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:52.904414 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-ef0b7bbe-530e-435e-a65b-9c6d0f191b28 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:52.904928 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-ef0b7bbe-530e-435e-a65b-9c6d0f191b28 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:52.912053 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ef0b7bbe-530e-435e-a65b-9c6d0f191b28 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:52.912502 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ef0b7bbe-530e-435e-a65b-9c6d0f191b28 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:52.913299 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ef0b7bbe-530e-435e-a65b-9c6d0f191b28 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:52.913724 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ef0b7bbe-530e-435e-a65b-9c6d0f191b28 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:53.060873 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-ef0b7bbe-530e-435e-a65b-9c6d0f191b28 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b554f95b7b4444ab70e9dabf8197de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fc732badb0488392694e6d6c67d5dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:53.069572 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-ef0b7bbe-530e-435e-a65b-9c6d0f191b28 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d" status: 200 len: 1568 microversion: 2.1 time: 0.169008 Dec 15 16:26:53.070156 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 376/763] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:52 2021] GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:53.388981 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-32680bb6-9601-4a6a-a8da-48a4d15500f5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:53.389563 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-32680bb6-9601-4a6a-a8da-48a4d15500f5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:53.396757 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-32680bb6-9601-4a6a-a8da-48a4d15500f5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:53.397210 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-32680bb6-9601-4a6a-a8da-48a4d15500f5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:53.397990 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-32680bb6-9601-4a6a-a8da-48a4d15500f5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:53.398425 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-32680bb6-9601-4a6a-a8da-48a4d15500f5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:53.542586 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-32680bb6-9601-4a6a-a8da-48a4d15500f5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:53.552836 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-32680bb6-9601-4a6a-a8da-48a4d15500f5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:53.554335 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-32680bb6-9601-4a6a-a8da-48a4d15500f5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:53.555524 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-32680bb6-9601-4a6a-a8da-48a4d15500f5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1807 microversion: 2.20 time: 0.170371 Dec 15 16:26:53.556103 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 388/764] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:26:53 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:26:53.638747 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-627066b0-df21-44f9-bc35-6d7a3ee3acac tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:53.639647 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-627066b0-df21-44f9-bc35-6d7a3ee3acac tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:53.653232 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-627066b0-df21-44f9-bc35-6d7a3ee3acac tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:53.654033 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-627066b0-df21-44f9-bc35-6d7a3ee3acac tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:53.655488 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-627066b0-df21-44f9-bc35-6d7a3ee3acac tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:53.656169 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-627066b0-df21-44f9-bc35-6d7a3ee3acac tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:53.790224 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-627066b0-df21-44f9-bc35-6d7a3ee3acac tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:53.798146 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-627066b0-df21-44f9-bc35-6d7a3ee3acac tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82" status: 200 len: 1362 microversion: 2.1 time: 0.165547 Dec 15 16:26:53.798846 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 377/765] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:53 2021] GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:53.799016 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-294c0cfd-b58b-4b52-bb87-2fc79198b5df tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:53.799698 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-294c0cfd-b58b-4b52-bb87-2fc79198b5df tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] [instance: b2c86622-4d3b-4750-9589-e485a89473cb] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:53.806975 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-294c0cfd-b58b-4b52-bb87-2fc79198b5df tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:53.807468 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-294c0cfd-b58b-4b52-bb87-2fc79198b5df tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:53.808290 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-294c0cfd-b58b-4b52-bb87-2fc79198b5df tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:53.808744 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-294c0cfd-b58b-4b52-bb87-2fc79198b5df tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:53.953899 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-294c0cfd-b58b-4b52-bb87-2fc79198b5df tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b8a0a1adc54ff4abafe90692d10543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f435a136a5e44f89a0b09d4ec7427b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:53.962274 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-294c0cfd-b58b-4b52-bb87-2fc79198b5df tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] 10.222.0.60 "GET /compute/v2.1/servers/b2c86622-4d3b-4750-9589-e485a89473cb" status: 200 len: 1512 microversion: 2.1 time: 0.167722 Dec 15 16:26:53.962843 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 389/766] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:53 2021] GET /compute/v2.1/servers/b2c86622-4d3b-4750-9589-e485a89473cb => generated 1512 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:54.088852 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-389267bf-dc8d-451e-842a-61d8fb512e98 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:54.089485 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-389267bf-dc8d-451e-842a-61d8fb512e98 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:54.096801 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-389267bf-dc8d-451e-842a-61d8fb512e98 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:54.097430 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-389267bf-dc8d-451e-842a-61d8fb512e98 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:54.098359 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-389267bf-dc8d-451e-842a-61d8fb512e98 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:54.098992 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-389267bf-dc8d-451e-842a-61d8fb512e98 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:54.247786 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-389267bf-dc8d-451e-842a-61d8fb512e98 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b554f95b7b4444ab70e9dabf8197de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fc732badb0488392694e6d6c67d5dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:54.256509 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-389267bf-dc8d-451e-842a-61d8fb512e98 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d" status: 200 len: 1568 microversion: 2.1 time: 0.172223 Dec 15 16:26:54.257612 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 378/767] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:54 2021] GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:54.574661 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-78883ef7-c7af-4bf8-924d-6733675d4c0d tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:54.575263 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-78883ef7-c7af-4bf8-924d-6733675d4c0d tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:54.582407 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-78883ef7-c7af-4bf8-924d-6733675d4c0d tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:54.582852 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-78883ef7-c7af-4bf8-924d-6733675d4c0d tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:54.583664 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-78883ef7-c7af-4bf8-924d-6733675d4c0d tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:54.584067 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-78883ef7-c7af-4bf8-924d-6733675d4c0d tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:54.737039 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-78883ef7-c7af-4bf8-924d-6733675d4c0d tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:54.745943 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-78883ef7-c7af-4bf8-924d-6733675d4c0d tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:54.747460 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-78883ef7-c7af-4bf8-924d-6733675d4c0d tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:54.748625 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-78883ef7-c7af-4bf8-924d-6733675d4c0d tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1807 microversion: 2.20 time: 0.177811 Dec 15 16:26:54.749180 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 390/768] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:26:54 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:26:54.817327 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-db876b71-99a3-4d64-9742-1c3ce4fea849 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:54.818571 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-db876b71-99a3-4d64-9742-1c3ce4fea849 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:54.825743 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-db876b71-99a3-4d64-9742-1c3ce4fea849 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:54.826272 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-db876b71-99a3-4d64-9742-1c3ce4fea849 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:54.827082 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-db876b71-99a3-4d64-9742-1c3ce4fea849 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:54.827552 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-db876b71-99a3-4d64-9742-1c3ce4fea849 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:54.972440 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-db876b71-99a3-4d64-9742-1c3ce4fea849 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:54.979488 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-55dee688-cef7-4454-9c11-efd44dc86f8c tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:54.980281 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-55dee688-cef7-4454-9c11-efd44dc86f8c tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] [instance: b2c86622-4d3b-4750-9589-e485a89473cb] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:54.981033 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-db876b71-99a3-4d64-9742-1c3ce4fea849 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82" status: 200 len: 1548 microversion: 2.1 time: 0.168053 Dec 15 16:26:54.981648 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 379/769] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:54 2021] GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82 => generated 1548 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:54.987246 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-55dee688-cef7-4454-9c11-efd44dc86f8c tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:54.987799 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-55dee688-cef7-4454-9c11-efd44dc86f8c tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:54.988535 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-55dee688-cef7-4454-9c11-efd44dc86f8c tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:54.988950 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-55dee688-cef7-4454-9c11-efd44dc86f8c tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:54.997683 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-0eb739ba-e477-459f-bd8d-d9e94acdbd13 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:54.998131 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-0eb739ba-e477-459f-bd8d-d9e94acdbd13 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:55.004751 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0eb739ba-e477-459f-bd8d-d9e94acdbd13 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:55.005197 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0eb739ba-e477-459f-bd8d-d9e94acdbd13 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:55.006054 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0eb739ba-e477-459f-bd8d-d9e94acdbd13 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:55.006815 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0eb739ba-e477-459f-bd8d-d9e94acdbd13 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:55.145503 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-0eb739ba-e477-459f-bd8d-d9e94acdbd13 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.151451 Dec 15 16:26:55.146912 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 380/770] 10.222.0.60 () {58 vars in 1274 bytes} [Wed Dec 15 16:26:54 2021] GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/os-interface => generated 285 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:26:55.194441 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-55dee688-cef7-4454-9c11-efd44dc86f8c tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b8a0a1adc54ff4abafe90692d10543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f435a136a5e44f89a0b09d4ec7427b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:55.203384 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-55dee688-cef7-4454-9c11-efd44dc86f8c tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] 10.222.0.60 "GET /compute/v2.1/servers/b2c86622-4d3b-4750-9589-e485a89473cb" status: 200 len: 1512 microversion: 2.1 time: 0.227687 Dec 15 16:26:55.214055 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 391/771] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:54 2021] GET /compute/v2.1/servers/b2c86622-4d3b-4750-9589-e485a89473cb => generated 1512 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:55.281919 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-b3356b22-0e7e-4da0-9244-c846fa409f4a tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:55.281919 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-b3356b22-0e7e-4da0-9244-c846fa409f4a tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:55.285652 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b3356b22-0e7e-4da0-9244-c846fa409f4a tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:55.286099 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b3356b22-0e7e-4da0-9244-c846fa409f4a tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:55.286886 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b3356b22-0e7e-4da0-9244-c846fa409f4a tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:55.287523 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b3356b22-0e7e-4da0-9244-c846fa409f4a tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:55.465997 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-b3356b22-0e7e-4da0-9244-c846fa409f4a tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b554f95b7b4444ab70e9dabf8197de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fc732badb0488392694e6d6c67d5dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:55.475580 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-b3356b22-0e7e-4da0-9244-c846fa409f4a tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d" status: 200 len: 1568 microversion: 2.1 time: 0.201296 Dec 15 16:26:55.488013 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 381/772] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:55 2021] GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d => generated 1568 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:55.772072 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-dc2626c3-cf19-4112-8738-2f9427048f9a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:55.772818 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-dc2626c3-cf19-4112-8738-2f9427048f9a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:55.779499 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dc2626c3-cf19-4112-8738-2f9427048f9a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:55.779944 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dc2626c3-cf19-4112-8738-2f9427048f9a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:55.780717 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dc2626c3-cf19-4112-8738-2f9427048f9a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:55.781136 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-dc2626c3-cf19-4112-8738-2f9427048f9a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:55.935999 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-dc2626c3-cf19-4112-8738-2f9427048f9a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:55.945866 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-dc2626c3-cf19-4112-8738-2f9427048f9a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:55.947509 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-dc2626c3-cf19-4112-8738-2f9427048f9a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:55.948740 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-dc2626c3-cf19-4112-8738-2f9427048f9a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1807 microversion: 2.20 time: 0.180444 Dec 15 16:26:55.949374 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 392/773] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:26:55 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1807 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:26:56.225647 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-80a31cd4-31cd-4bde-88b0-8fc3e05f5ac9 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:56.226484 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-80a31cd4-31cd-4bde-88b0-8fc3e05f5ac9 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] [instance: b2c86622-4d3b-4750-9589-e485a89473cb] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:56.236311 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-80a31cd4-31cd-4bde-88b0-8fc3e05f5ac9 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:56.236877 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-80a31cd4-31cd-4bde-88b0-8fc3e05f5ac9 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:56.238142 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-80a31cd4-31cd-4bde-88b0-8fc3e05f5ac9 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:56.238658 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-80a31cd4-31cd-4bde-88b0-8fc3e05f5ac9 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:56.392821 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-80a31cd4-31cd-4bde-88b0-8fc3e05f5ac9 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b8a0a1adc54ff4abafe90692d10543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f435a136a5e44f89a0b09d4ec7427b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:56.400732 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-80a31cd4-31cd-4bde-88b0-8fc3e05f5ac9 tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] 10.222.0.60 "GET /compute/v2.1/servers/b2c86622-4d3b-4750-9589-e485a89473cb" status: 200 len: 1512 microversion: 2.1 time: 0.183326 Dec 15 16:26:56.401306 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 382/774] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:56 2021] GET /compute/v2.1/servers/b2c86622-4d3b-4750-9589-e485a89473cb => generated 1512 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:56.494079 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-66527be6-6c4a-47e9-a0a9-85a02f1a2813 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:56.494569 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-66527be6-6c4a-47e9-a0a9-85a02f1a2813 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:56.511334 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-66527be6-6c4a-47e9-a0a9-85a02f1a2813 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:56.512581 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-66527be6-6c4a-47e9-a0a9-85a02f1a2813 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:56.513580 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-66527be6-6c4a-47e9-a0a9-85a02f1a2813 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:56.514060 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-66527be6-6c4a-47e9-a0a9-85a02f1a2813 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:56.557527 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-d912ed88-5b89-4fb5-a58d-ea121c4a835d req-42f2b499-4d66-41f2-a2b2-4bbe65cf8e3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2c86622-4d3b-4750-9589-e485a89473cb", "name": "network-vif-deleted", "tag": "201a5147-a21d-4bd9-8def-2ce8d86621a5"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:26:56.559151 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:26:56.559151 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Dec 15 16:26:56.572384 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-d912ed88-5b89-4fb5-a58d-ea121c4a835d req-42f2b499-4d66-41f2-a2b2-4bbe65cf8e3e service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:56.572827 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-d912ed88-5b89-4fb5-a58d-ea121c4a835d req-42f2b499-4d66-41f2-a2b2-4bbe65cf8e3e service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:56.599744 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-d912ed88-5b89-4fb5-a58d-ea121c4a835d req-42f2b499-4d66-41f2-a2b2-4bbe65cf8e3e service nova] Creating event network-vif-deleted:201a5147-a21d-4bd9-8def-2ce8d86621a5 for instance b2c86622-4d3b-4750-9589-e485a89473cb on hv-cinder-81268 Dec 15 16:26:56.613572 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-d912ed88-5b89-4fb5-a58d-ea121c4a835d req-42f2b499-4d66-41f2-a2b2-4bbe65cf8e3e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059581 Dec 15 16:26:56.614304 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 383/775] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:26:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:26:56.687442 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-767952c8-6f3d-450d-81ce-ca0a800bc624 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:26:56.689155 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-767952c8-6f3d-450d-81ce-ca0a800bc624 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:56.698046 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-767952c8-6f3d-450d-81ce-ca0a800bc624 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:56.698787 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-767952c8-6f3d-450d-81ce-ca0a800bc624 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:56.699962 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-767952c8-6f3d-450d-81ce-ca0a800bc624 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:56.700395 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-767952c8-6f3d-450d-81ce-ca0a800bc624 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:56.729534 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-66527be6-6c4a-47e9-a0a9-85a02f1a2813 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b554f95b7b4444ab70e9dabf8197de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fc732badb0488392694e6d6c67d5dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:56.738286 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-66527be6-6c4a-47e9-a0a9-85a02f1a2813 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d" status: 200 len: 1509 microversion: 2.1 time: 0.247895 Dec 15 16:26:56.738881 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 393/776] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:56 2021] GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d => generated 1509 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:56.757688 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-203577d7-2bbc-4f79-bf15-d5bc49416abb tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:26:56.758253 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-203577d7-2bbc-4f79-bf15-d5bc49416abb tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:56.763321 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-767952c8-6f3d-450d-81ce-ca0a800bc624 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action" status: 200 len: 14 microversion: 2.1 time: 0.080583 Dec 15 16:26:56.764785 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 384/777] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:26:56 2021] POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:26:56.769730 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-203577d7-2bbc-4f79-bf15-d5bc49416abb tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:56.770277 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-203577d7-2bbc-4f79-bf15-d5bc49416abb tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:56.771197 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-203577d7-2bbc-4f79-bf15-d5bc49416abb tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:56.771916 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-203577d7-2bbc-4f79-bf15-d5bc49416abb tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:56.984073 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-da980989-89fd-4734-9535-81e1620d6383 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:56.989494 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-da980989-89fd-4734-9535-81e1620d6383 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:56.990334 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-203577d7-2bbc-4f79-bf15-d5bc49416abb tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "POST /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d/action" status: 202 len: 0 microversion: 2.1 time: 0.236968 Dec 15 16:26:56.995342 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 394/778] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:26:56 2021] POST /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:26:57.008725 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-7b3eb339-809a-4a07-9c3c-8365f3939855 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:57.009815 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-7b3eb339-809a-4a07-9c3c-8365f3939855 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:57.021441 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7b3eb339-809a-4a07-9c3c-8365f3939855 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:57.022218 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7b3eb339-809a-4a07-9c3c-8365f3939855 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:57.023339 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-da980989-89fd-4734-9535-81e1620d6383 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:57.023567 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7b3eb339-809a-4a07-9c3c-8365f3939855 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:57.024132 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-da980989-89fd-4734-9535-81e1620d6383 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:57.024557 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7b3eb339-809a-4a07-9c3c-8365f3939855 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:57.030653 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-da980989-89fd-4734-9535-81e1620d6383 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:57.033460 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-da980989-89fd-4734-9535-81e1620d6383 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:57.357984 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-7b3eb339-809a-4a07-9c3c-8365f3939855 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b554f95b7b4444ab70e9dabf8197de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fc732badb0488392694e6d6c67d5dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:57.365150 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-da980989-89fd-4734-9535-81e1620d6383 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:57.368485 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-7b3eb339-809a-4a07-9c3c-8365f3939855 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d" status: 200 len: 1517 microversion: 2.1 time: 0.370679 Dec 15 16:26:57.369786 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 395/779] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:56 2021] GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d => generated 1517 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:26:57.381266 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-da980989-89fd-4734-9535-81e1620d6383 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:57.384904 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-da980989-89fd-4734-9535-81e1620d6383 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:57.386302 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-da980989-89fd-4734-9535-81e1620d6383 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1807 microversion: 2.20 time: 0.421185 Dec 15 16:26:57.386997 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 385/780] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:26:56 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1807 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:26:57.419204 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-129a5de9-e507-4b04-923d-8a67acf739dd tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:57.420147 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-129a5de9-e507-4b04-923d-8a67acf739dd tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] [instance: b2c86622-4d3b-4750-9589-e485a89473cb] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:57.427679 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-129a5de9-e507-4b04-923d-8a67acf739dd tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:57.428126 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-129a5de9-e507-4b04-923d-8a67acf739dd tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:57.428939 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-129a5de9-e507-4b04-923d-8a67acf739dd tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:57.429375 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-129a5de9-e507-4b04-923d-8a67acf739dd tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:57.453171 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-129a5de9-e507-4b04-923d-8a67acf739dd tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] HTTP exception thrown: Instance b2c86622-4d3b-4750-9589-e485a89473cb could not be found. Dec 15 16:26:57.453763 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-129a5de9-e507-4b04-923d-8a67acf739dd tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] Returning 404 to user: Instance b2c86622-4d3b-4750-9589-e485a89473cb could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:26:57.455083 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-129a5de9-e507-4b04-923d-8a67acf739dd tempest-VolumesSnapshotTestJSON-554769247 tempest-VolumesSnapshotTestJSON-554769247-project] 10.222.0.60 "GET /compute/v2.1/servers/b2c86622-4d3b-4750-9589-e485a89473cb" status: 404 len: 111 microversion: 2.1 time: 0.039259 Dec 15 16:26:57.460112 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 396/781] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:57 2021] GET /compute/v2.1/servers/b2c86622-4d3b-4750-9589-e485a89473cb => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:26:57.786654 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-48bc8e75-e41d-4cc3-97ef-42b0f7ac5602 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:26:57.789113 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-48bc8e75-e41d-4cc3-97ef-42b0f7ac5602 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:57.816642 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-48bc8e75-e41d-4cc3-97ef-42b0f7ac5602 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:57.817572 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-48bc8e75-e41d-4cc3-97ef-42b0f7ac5602 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:57.819056 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-48bc8e75-e41d-4cc3-97ef-42b0f7ac5602 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:57.819542 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-48bc8e75-e41d-4cc3-97ef-42b0f7ac5602 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:57.894365 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-48bc8e75-e41d-4cc3-97ef-42b0f7ac5602 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action" status: 200 len: 14 microversion: 2.1 time: 0.122401 Dec 15 16:26:57.895895 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 386/782] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:26:57 2021] POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:26:58.388171 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-21834d80-c2b1-470c-b954-61e42856f31c tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:58.389276 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-21834d80-c2b1-470c-b954-61e42856f31c tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:58.395989 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-21834d80-c2b1-470c-b954-61e42856f31c tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:58.396444 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-21834d80-c2b1-470c-b954-61e42856f31c tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:58.397461 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-21834d80-c2b1-470c-b954-61e42856f31c tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:58.397691 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-21834d80-c2b1-470c-b954-61e42856f31c tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:58.409487 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-6d966d18-5325-4a2c-badd-5ba94f686932 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:58.410960 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-6d966d18-5325-4a2c-badd-5ba94f686932 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:58.419705 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6d966d18-5325-4a2c-badd-5ba94f686932 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:58.420496 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6d966d18-5325-4a2c-badd-5ba94f686932 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:58.421304 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6d966d18-5325-4a2c-badd-5ba94f686932 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:58.421739 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6d966d18-5325-4a2c-badd-5ba94f686932 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:58.663657 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-6d966d18-5325-4a2c-badd-5ba94f686932 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:58.667246 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-21834d80-c2b1-470c-b954-61e42856f31c tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b554f95b7b4444ab70e9dabf8197de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fc732badb0488392694e6d6c67d5dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:58.675914 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-6d966d18-5325-4a2c-badd-5ba94f686932 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:58.676507 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-21834d80-c2b1-470c-b954-61e42856f31c tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d" status: 200 len: 1519 microversion: 2.1 time: 0.293533 Dec 15 16:26:58.677403 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 397/783] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:58 2021] GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d => generated 1519 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:58.687800 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-6d966d18-5325-4a2c-badd-5ba94f686932 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:58.690375 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-6d966d18-5325-4a2c-badd-5ba94f686932 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1807 microversion: 2.20 time: 0.284909 Dec 15 16:26:58.691382 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 387/784] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:26:58 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1807 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:26:58.692233 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-80d1c547-c8f1-4ada-8b25-f790a20ecfbf req-b8d3762f-c5d0-435a-84b1-309e71e98ece service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aace7dfb-6043-406a-b7cf-4a633e026c82", "tag": "3ec4fed8-77d3-444b-b5eb-09f908b0f166"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:26:58.693878 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:26:58.693878 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:26:58.702043 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-80d1c547-c8f1-4ada-8b25-f790a20ecfbf req-b8d3762f-c5d0-435a-84b1-309e71e98ece service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:58.702492 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-80d1c547-c8f1-4ada-8b25-f790a20ecfbf req-b8d3762f-c5d0-435a-84b1-309e71e98ece service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:58.714355 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-80d1c547-c8f1-4ada-8b25-f790a20ecfbf req-b8d3762f-c5d0-435a-84b1-309e71e98ece service nova] Creating event network-changed:3ec4fed8-77d3-444b-b5eb-09f908b0f166 for instance aace7dfb-6043-406a-b7cf-4a633e026c82 on hv-cinder-81268 Dec 15 16:26:58.719642 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-80d1c547-c8f1-4ada-8b25-f790a20ecfbf req-b8d3762f-c5d0-435a-84b1-309e71e98ece service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040848 Dec 15 16:26:58.720345 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 398/785] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:26:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:26:58.841980 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-029c2766-4f5c-4fa6-b65b-f1d445555656 req-57fd25d4-385b-440d-868d-39178596a352 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "049761b5-88eb-4325-af0e-03da2842cbf5", "name": "network-vif-plugged", "status": "completed", "tag": "71e495aa-7e03-4d0e-9f9d-b7560a684e27"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:26:58.844343 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:26:58.844343 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Dec 15 16:26:58.854171 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-029c2766-4f5c-4fa6-b65b-f1d445555656 req-57fd25d4-385b-440d-868d-39178596a352 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:58.854845 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-029c2766-4f5c-4fa6-b65b-f1d445555656 req-57fd25d4-385b-440d-868d-39178596a352 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:58.868983 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-029c2766-4f5c-4fa6-b65b-f1d445555656 req-57fd25d4-385b-440d-868d-39178596a352 service nova] Creating event network-vif-plugged:71e495aa-7e03-4d0e-9f9d-b7560a684e27 for instance 049761b5-88eb-4325-af0e-03da2842cbf5 on hv-cinder-81268 Dec 15 16:26:58.879183 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-029c2766-4f5c-4fa6-b65b-f1d445555656 req-57fd25d4-385b-440d-868d-39178596a352 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182477 Dec 15 16:26:58.880574 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 388/786] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:26:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:26:58.910437 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-87dd1598-b133-4307-9daf-1a0790fe3f62 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:26:58.911978 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-87dd1598-b133-4307-9daf-1a0790fe3f62 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:58.927491 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-87dd1598-b133-4307-9daf-1a0790fe3f62 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:58.928093 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-87dd1598-b133-4307-9daf-1a0790fe3f62 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:58.929619 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-87dd1598-b133-4307-9daf-1a0790fe3f62 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:58.932966 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-87dd1598-b133-4307-9daf-1a0790fe3f62 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:59.007576 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-87dd1598-b133-4307-9daf-1a0790fe3f62 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action" status: 200 len: 14 microversion: 2.1 time: 0.104295 Dec 15 16:26:59.008614 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 399/787] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:26:58 2021] POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:26:59.697313 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-ecd75039-9adf-4771-9992-e2d1eeccd3c4 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:59.698027 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-ecd75039-9adf-4771-9992-e2d1eeccd3c4 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:59.705395 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ecd75039-9adf-4771-9992-e2d1eeccd3c4 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:59.705849 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ecd75039-9adf-4771-9992-e2d1eeccd3c4 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:59.706639 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ecd75039-9adf-4771-9992-e2d1eeccd3c4 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:59.707073 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ecd75039-9adf-4771-9992-e2d1eeccd3c4 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:59.715121 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-6ff0ee55-47e7-4774-aaf6-b2e8c2a559ce tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:26:59.715852 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-6ff0ee55-47e7-4774-aaf6-b2e8c2a559ce tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:26:59.723104 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6ff0ee55-47e7-4774-aaf6-b2e8c2a559ce tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:59.723582 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6ff0ee55-47e7-4774-aaf6-b2e8c2a559ce tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:59.724377 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6ff0ee55-47e7-4774-aaf6-b2e8c2a559ce tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:26:59.724815 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6ff0ee55-47e7-4774-aaf6-b2e8c2a559ce tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:26:59.911033 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-ecd75039-9adf-4771-9992-e2d1eeccd3c4 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b554f95b7b4444ab70e9dabf8197de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fc732badb0488392694e6d6c67d5dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:59.914318 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-6ff0ee55-47e7-4774-aaf6-b2e8c2a559ce tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:59.919027 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-ecd75039-9adf-4771-9992-e2d1eeccd3c4 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d" status: 200 len: 1575 microversion: 2.1 time: 0.226322 Dec 15 16:26:59.919720 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 389/788] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:26:59 2021] GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d => generated 1575 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:26:59.924003 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-6ff0ee55-47e7-4774-aaf6-b2e8c2a559ce tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:59.925269 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-6ff0ee55-47e7-4774-aaf6-b2e8c2a559ce tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:26:59.926298 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-6ff0ee55-47e7-4774-aaf6-b2e8c2a559ce tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1807 microversion: 2.20 time: 0.215925 Dec 15 16:26:59.927001 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 400/789] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:26:59 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1807 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:27:00.020677 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-e41a297c-7a85-4a7a-9049-fb6ca0f34260 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:27:00.022020 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-e41a297c-7a85-4a7a-9049-fb6ca0f34260 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:00.029969 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e41a297c-7a85-4a7a-9049-fb6ca0f34260 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:00.030583 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e41a297c-7a85-4a7a-9049-fb6ca0f34260 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:00.031801 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e41a297c-7a85-4a7a-9049-fb6ca0f34260 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:00.032407 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e41a297c-7a85-4a7a-9049-fb6ca0f34260 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:00.920611 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-1922c130-b2d0-467b-a548-0e66356cdeab req-28c301c9-4561-4e16-8648-8fc4fa8ad3c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afd5ac96-daf3-4608-818c-190e076c2f6d", "name": "network-vif-unplugged", "status": "completed", "tag": "7f96dd5b-86e2-412f-920f-6abc632fd890"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:27:00.922253 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:27:00.922253 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:27:00.931278 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-1922c130-b2d0-467b-a548-0e66356cdeab req-28c301c9-4561-4e16-8648-8fc4fa8ad3c6 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:00.931752 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-1922c130-b2d0-467b-a548-0e66356cdeab req-28c301c9-4561-4e16-8648-8fc4fa8ad3c6 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:00.944644 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-1922c130-b2d0-467b-a548-0e66356cdeab req-28c301c9-4561-4e16-8648-8fc4fa8ad3c6 service nova] Creating event network-vif-unplugged:7f96dd5b-86e2-412f-920f-6abc632fd890 for instance afd5ac96-daf3-4608-818c-190e076c2f6d on hv-cinder-81268 Dec 15 16:27:00.950570 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-1922c130-b2d0-467b-a548-0e66356cdeab req-28c301c9-4561-4e16-8648-8fc4fa8ad3c6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033658 Dec 15 16:27:00.951240 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 401/790] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:27:00 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:27:00.956836 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f6af7355-f8b8-446c-84e8-b3e9c89211e0 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:00.957535 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f6af7355-f8b8-446c-84e8-b3e9c89211e0 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:00.964808 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f6af7355-f8b8-446c-84e8-b3e9c89211e0 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:00.965258 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f6af7355-f8b8-446c-84e8-b3e9c89211e0 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:00.966064 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f6af7355-f8b8-446c-84e8-b3e9c89211e0 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:00.966498 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f6af7355-f8b8-446c-84e8-b3e9c89211e0 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:01.117876 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f6af7355-f8b8-446c-84e8-b3e9c89211e0 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b554f95b7b4444ab70e9dabf8197de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fc732badb0488392694e6d6c67d5dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:01.128366 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f6af7355-f8b8-446c-84e8-b3e9c89211e0 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d" status: 200 len: 1575 microversion: 2.1 time: 0.175986 Dec 15 16:27:01.128953 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 402/791] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:00 2021] GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d => generated 1575 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:01.133212 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e150b887-e7af-4f76-903e-88515f359476 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:01.133796 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e150b887-e7af-4f76-903e-88515f359476 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:01.139396 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e150b887-e7af-4f76-903e-88515f359476 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:01.139860 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e150b887-e7af-4f76-903e-88515f359476 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:01.140621 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e150b887-e7af-4f76-903e-88515f359476 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:01.141041 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e150b887-e7af-4f76-903e-88515f359476 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:01.273866 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e150b887-e7af-4f76-903e-88515f359476 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:01.286355 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e150b887-e7af-4f76-903e-88515f359476 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:01.288744 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e150b887-e7af-4f76-903e-88515f359476 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:01.290454 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e150b887-e7af-4f76-903e-88515f359476 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1807 microversion: 2.20 time: 0.160112 Dec 15 16:27:01.291853 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 403/792] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:27:01 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:27:02.120693 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-e41a297c-7a85-4a7a-9049-fb6ca0f34260 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action" status: 200 len: 14 microversion: 2.1 time: 2.105025 Dec 15 16:27:02.124059 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 390/793] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:27:00 2021] POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action => generated 14 bytes in 2107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:27:02.146374 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e110c888-ddc5-4f41-b00c-f7cfcb0cf233 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:02.147240 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e110c888-ddc5-4f41-b00c-f7cfcb0cf233 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:02.160415 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e110c888-ddc5-4f41-b00c-f7cfcb0cf233 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:02.161054 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e110c888-ddc5-4f41-b00c-f7cfcb0cf233 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:02.162268 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e110c888-ddc5-4f41-b00c-f7cfcb0cf233 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:02.163018 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e110c888-ddc5-4f41-b00c-f7cfcb0cf233 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:02.313257 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-11b95768-30d6-47f5-8978-015b94fa42ce tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:02.314341 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-11b95768-30d6-47f5-8978-015b94fa42ce tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:02.321233 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-11b95768-30d6-47f5-8978-015b94fa42ce tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:02.321573 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-11b95768-30d6-47f5-8978-015b94fa42ce tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:02.322547 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-11b95768-30d6-47f5-8978-015b94fa42ce tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:02.323198 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-11b95768-30d6-47f5-8978-015b94fa42ce tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:02.333841 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e110c888-ddc5-4f41-b00c-f7cfcb0cf233 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b554f95b7b4444ab70e9dabf8197de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fc732badb0488392694e6d6c67d5dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:02.341121 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e110c888-ddc5-4f41-b00c-f7cfcb0cf233 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d" status: 200 len: 1575 microversion: 2.1 time: 0.198921 Dec 15 16:27:02.341690 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 404/794] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:02 2021] GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d => generated 1575 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:02.479417 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-11b95768-30d6-47f5-8978-015b94fa42ce tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:02.489659 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-11b95768-30d6-47f5-8978-015b94fa42ce tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:02.491192 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-11b95768-30d6-47f5-8978-015b94fa42ce tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:02.492475 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-11b95768-30d6-47f5-8978-015b94fa42ce tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1807 microversion: 2.20 time: 0.183356 Dec 15 16:27:02.493535 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 391/795] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:27:02 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1807 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:27:03.131918 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ff0a73cd-e580-40b4-a932-9d1c5dc55c47 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:27:03.132870 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ff0a73cd-e580-40b4-a932-9d1c5dc55c47 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:03.145107 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ff0a73cd-e580-40b4-a932-9d1c5dc55c47 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:03.145546 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ff0a73cd-e580-40b4-a932-9d1c5dc55c47 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:03.146548 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ff0a73cd-e580-40b4-a932-9d1c5dc55c47 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:03.147130 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ff0a73cd-e580-40b4-a932-9d1c5dc55c47 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:03.226651 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ff0a73cd-e580-40b4-a932-9d1c5dc55c47 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action" status: 200 len: 14 microversion: 2.1 time: 0.098343 Dec 15 16:27:03.227347 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 405/796] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:27:03 2021] POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:27:03.358600 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-d1b89c48-aff9-456c-9a57-2f27aa128057 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:03.359214 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-d1b89c48-aff9-456c-9a57-2f27aa128057 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:03.365997 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d1b89c48-aff9-456c-9a57-2f27aa128057 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:03.366462 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d1b89c48-aff9-456c-9a57-2f27aa128057 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:03.367230 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d1b89c48-aff9-456c-9a57-2f27aa128057 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:03.367731 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d1b89c48-aff9-456c-9a57-2f27aa128057 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:03.514099 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-176d6f3b-d02b-4102-9e1a-1321141a8e36 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:03.514804 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-176d6f3b-d02b-4102-9e1a-1321141a8e36 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:03.523962 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-176d6f3b-d02b-4102-9e1a-1321141a8e36 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:03.524426 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-176d6f3b-d02b-4102-9e1a-1321141a8e36 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:03.525236 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-176d6f3b-d02b-4102-9e1a-1321141a8e36 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:03.525702 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-176d6f3b-d02b-4102-9e1a-1321141a8e36 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:03.542197 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-d1b89c48-aff9-456c-9a57-2f27aa128057 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b554f95b7b4444ab70e9dabf8197de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fc732badb0488392694e6d6c67d5dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:03.551651 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-d1b89c48-aff9-456c-9a57-2f27aa128057 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d" status: 200 len: 1575 microversion: 2.1 time: 0.197144 Dec 15 16:27:03.554074 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 392/797] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:03 2021] GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d => generated 1575 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:03.708148 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-176d6f3b-d02b-4102-9e1a-1321141a8e36 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:03.718007 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-176d6f3b-d02b-4102-9e1a-1321141a8e36 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:03.719697 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-176d6f3b-d02b-4102-9e1a-1321141a8e36 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:03.721154 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-176d6f3b-d02b-4102-9e1a-1321141a8e36 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1807 microversion: 2.20 time: 0.211986 Dec 15 16:27:03.721723 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 406/798] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:27:03 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1807 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:27:04.238413 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-f99a7f29-ef9d-4620-98a9-fdc98c5a87f4 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:27:04.239304 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-f99a7f29-ef9d-4620-98a9-fdc98c5a87f4 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:04.246638 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f99a7f29-ef9d-4620-98a9-fdc98c5a87f4 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:04.247714 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f99a7f29-ef9d-4620-98a9-fdc98c5a87f4 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:04.248712 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f99a7f29-ef9d-4620-98a9-fdc98c5a87f4 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:04.249152 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f99a7f29-ef9d-4620-98a9-fdc98c5a87f4 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:04.327763 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-f99a7f29-ef9d-4620-98a9-fdc98c5a87f4 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action" status: 200 len: 3437 microversion: 2.1 time: 0.093094 Dec 15 16:27:04.328552 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 393/799] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:27:04 2021] POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action => generated 3437 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:04.571886 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-20e86b32-a24b-49a3-a770-7ebb3486d283 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:04.572519 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-20e86b32-a24b-49a3-a770-7ebb3486d283 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:04.579768 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-20e86b32-a24b-49a3-a770-7ebb3486d283 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:04.580218 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-20e86b32-a24b-49a3-a770-7ebb3486d283 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:04.581011 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-20e86b32-a24b-49a3-a770-7ebb3486d283 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:04.581440 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-20e86b32-a24b-49a3-a770-7ebb3486d283 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:04.726808 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-20e86b32-a24b-49a3-a770-7ebb3486d283 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b554f95b7b4444ab70e9dabf8197de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fc732badb0488392694e6d6c67d5dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:04.735330 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-20e86b32-a24b-49a3-a770-7ebb3486d283 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d" status: 200 len: 1575 microversion: 2.1 time: 0.167116 Dec 15 16:27:04.736278 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 407/800] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:04 2021] GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:04.741514 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-391d7fc3-c6e1-4598-b75a-94828ddb4a2a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:04.742234 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-391d7fc3-c6e1-4598-b75a-94828ddb4a2a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:04.749926 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-391d7fc3-c6e1-4598-b75a-94828ddb4a2a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:04.750375 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-391d7fc3-c6e1-4598-b75a-94828ddb4a2a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:04.751166 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-391d7fc3-c6e1-4598-b75a-94828ddb4a2a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:04.751914 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-391d7fc3-c6e1-4598-b75a-94828ddb4a2a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:04.897401 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-391d7fc3-c6e1-4598-b75a-94828ddb4a2a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:04.912692 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-391d7fc3-c6e1-4598-b75a-94828ddb4a2a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:04.915014 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-391d7fc3-c6e1-4598-b75a-94828ddb4a2a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:04.916270 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-391d7fc3-c6e1-4598-b75a-94828ddb4a2a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1794 microversion: 2.20 time: 0.179175 Dec 15 16:27:04.917052 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 394/801] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:27:04 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1794 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:27:05.341547 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-25adb666-93c9-43e4-a2aa-d7ef01958263 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:27:05.342689 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-25adb666-93c9-43e4-a2aa-d7ef01958263 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:05.352063 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-25adb666-93c9-43e4-a2aa-d7ef01958263 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:05.352690 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-25adb666-93c9-43e4-a2aa-d7ef01958263 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:05.353936 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-25adb666-93c9-43e4-a2aa-d7ef01958263 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:05.354551 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-25adb666-93c9-43e4-a2aa-d7ef01958263 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:05.430029 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-25adb666-93c9-43e4-a2aa-d7ef01958263 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action" status: 200 len: 15025 microversion: 2.1 time: 0.093617 Dec 15 16:27:05.430665 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 408/802] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:27:05 2021] POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action => generated 15025 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:05.755638 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-f7e9e3bb-a233-4e19-a31c-dd25638fe41e tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:05.756494 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-f7e9e3bb-a233-4e19-a31c-dd25638fe41e tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:05.766388 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f7e9e3bb-a233-4e19-a31c-dd25638fe41e tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:05.767054 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f7e9e3bb-a233-4e19-a31c-dd25638fe41e tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:05.768262 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f7e9e3bb-a233-4e19-a31c-dd25638fe41e tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:05.768691 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f7e9e3bb-a233-4e19-a31c-dd25638fe41e tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:05.911625 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-f7e9e3bb-a233-4e19-a31c-dd25638fe41e tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b554f95b7b4444ab70e9dabf8197de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fc732badb0488392694e6d6c67d5dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:05.923185 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-f7e9e3bb-a233-4e19-a31c-dd25638fe41e tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d" status: 200 len: 1575 microversion: 2.1 time: 0.172625 Dec 15 16:27:05.924121 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 395/803] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:05 2021] GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d => generated 1575 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:06.443458 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-6849e3ae-95f3-42d3-80aa-b3004b660718 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:27:06.444530 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-6849e3ae-95f3-42d3-80aa-b3004b660718 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:06.452114 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6849e3ae-95f3-42d3-80aa-b3004b660718 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:06.452557 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6849e3ae-95f3-42d3-80aa-b3004b660718 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:06.453359 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6849e3ae-95f3-42d3-80aa-b3004b660718 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:06.453788 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6849e3ae-95f3-42d3-80aa-b3004b660718 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:06.531920 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-6849e3ae-95f3-42d3-80aa-b3004b660718 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action" status: 200 len: 18561 microversion: 2.1 time: 0.092978 Dec 15 16:27:06.532750 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 409/804] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:27:06 2021] POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action => generated 18561 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:06.948214 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-ff7815c4-67ad-42b9-8b10-39aa3e8224f1 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:06.948807 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-ff7815c4-67ad-42b9-8b10-39aa3e8224f1 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:06.957936 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ff7815c4-67ad-42b9-8b10-39aa3e8224f1 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:06.958520 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ff7815c4-67ad-42b9-8b10-39aa3e8224f1 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:06.959596 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ff7815c4-67ad-42b9-8b10-39aa3e8224f1 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:06.960156 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ff7815c4-67ad-42b9-8b10-39aa3e8224f1 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:07.109394 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-ff7815c4-67ad-42b9-8b10-39aa3e8224f1 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b554f95b7b4444ab70e9dabf8197de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fc732badb0488392694e6d6c67d5dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:07.120445 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-ff7815c4-67ad-42b9-8b10-39aa3e8224f1 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d" status: 200 len: 1575 microversion: 2.1 time: 0.176991 Dec 15 16:27:07.121204 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 396/805] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:06 2021] GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d => generated 1575 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:07.547754 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-cce4e340-49a3-4903-879a-62639f5c871a tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:27:07.549030 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-cce4e340-49a3-4903-879a-62639f5c871a tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:07.556665 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cce4e340-49a3-4903-879a-62639f5c871a tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:07.557143 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cce4e340-49a3-4903-879a-62639f5c871a tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:07.557930 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cce4e340-49a3-4903-879a-62639f5c871a tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:07.558367 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cce4e340-49a3-4903-879a-62639f5c871a tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:08.138231 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-4a847898-b871-4722-9941-52398b2d466d tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:08.138819 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-4a847898-b871-4722-9941-52398b2d466d tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:08.145733 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4a847898-b871-4722-9941-52398b2d466d tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:08.146193 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4a847898-b871-4722-9941-52398b2d466d tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:08.146972 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4a847898-b871-4722-9941-52398b2d466d tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:08.147422 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4a847898-b871-4722-9941-52398b2d466d tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:08.289820 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-4a847898-b871-4722-9941-52398b2d466d tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b554f95b7b4444ab70e9dabf8197de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fc732badb0488392694e6d6c67d5dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:08.297904 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-4a847898-b871-4722-9941-52398b2d466d tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d" status: 200 len: 1575 microversion: 2.1 time: 0.163544 Dec 15 16:27:08.298485 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 397/806] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:08 2021] GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:09.317961 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-b1f18bff-8826-4a66-ac8c-87c49af39d5b tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:09.318631 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-b1f18bff-8826-4a66-ac8c-87c49af39d5b tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:09.325294 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b1f18bff-8826-4a66-ac8c-87c49af39d5b tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:09.325738 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b1f18bff-8826-4a66-ac8c-87c49af39d5b tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:09.326512 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b1f18bff-8826-4a66-ac8c-87c49af39d5b tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:09.326938 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b1f18bff-8826-4a66-ac8c-87c49af39d5b tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:09.451343 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-cce4e340-49a3-4903-879a-62639f5c871a tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action" status: 200 len: 23235 microversion: 2.1 time: 1.909872 Dec 15 16:27:09.455232 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 410/807] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:27:07 2021] POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action => generated 23235 bytes in 1913 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:09.474135 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-b1f18bff-8826-4a66-ac8c-87c49af39d5b tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b554f95b7b4444ab70e9dabf8197de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fc732badb0488392694e6d6c67d5dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:09.481946 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-b1f18bff-8826-4a66-ac8c-87c49af39d5b tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d" status: 200 len: 1575 microversion: 2.1 time: 0.168896 Dec 15 16:27:09.482485 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 398/808] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:09 2021] GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:10.463861 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-3988826f-0583-46b7-9f01-5b10980908e8 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:27:10.464864 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-3988826f-0583-46b7-9f01-5b10980908e8 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:10.472889 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3988826f-0583-46b7-9f01-5b10980908e8 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:10.473327 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3988826f-0583-46b7-9f01-5b10980908e8 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:10.474141 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3988826f-0583-46b7-9f01-5b10980908e8 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:10.474573 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3988826f-0583-46b7-9f01-5b10980908e8 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:10.500198 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-79ebbd99-c060-47e7-a4c0-db0f0e1ea0b5 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:10.501155 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-79ebbd99-c060-47e7-a4c0-db0f0e1ea0b5 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:10.508435 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-79ebbd99-c060-47e7-a4c0-db0f0e1ea0b5 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:10.508953 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-79ebbd99-c060-47e7-a4c0-db0f0e1ea0b5 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:10.510026 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-79ebbd99-c060-47e7-a4c0-db0f0e1ea0b5 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:10.510500 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-79ebbd99-c060-47e7-a4c0-db0f0e1ea0b5 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:10.555525 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-3988826f-0583-46b7-9f01-5b10980908e8 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action" status: 200 len: 24523 microversion: 2.1 time: 0.094705 Dec 15 16:27:10.560647 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 411/809] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:27:10 2021] POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action => generated 24523 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:10.657935 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-79ebbd99-c060-47e7-a4c0-db0f0e1ea0b5 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b554f95b7b4444ab70e9dabf8197de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fc732badb0488392694e6d6c67d5dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:10.666159 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-79ebbd99-c060-47e7-a4c0-db0f0e1ea0b5 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d" status: 200 len: 1575 microversion: 2.1 time: 0.170546 Dec 15 16:27:10.666809 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 399/810] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:10 2021] GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:27:11.570111 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-540e6693-9104-49fd-9f17-96b4cdfddb82 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:27:11.571120 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-540e6693-9104-49fd-9f17-96b4cdfddb82 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:11.578685 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-540e6693-9104-49fd-9f17-96b4cdfddb82 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:11.579053 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-540e6693-9104-49fd-9f17-96b4cdfddb82 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:11.579907 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-540e6693-9104-49fd-9f17-96b4cdfddb82 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:11.580344 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-540e6693-9104-49fd-9f17-96b4cdfddb82 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:11.660751 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-540e6693-9104-49fd-9f17-96b4cdfddb82 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action" status: 200 len: 25908 microversion: 2.1 time: 0.094909 Dec 15 16:27:11.662511 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 412/811] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:27:11 2021] POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action => generated 25908 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:11.683174 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-e96d1255-1995-4b47-9913-c7c05bf3597a tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:11.683807 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-e96d1255-1995-4b47-9913-c7c05bf3597a tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:11.690443 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e96d1255-1995-4b47-9913-c7c05bf3597a tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:11.690949 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e96d1255-1995-4b47-9913-c7c05bf3597a tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:11.691778 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e96d1255-1995-4b47-9913-c7c05bf3597a tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:11.692183 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e96d1255-1995-4b47-9913-c7c05bf3597a tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:11.838740 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-e96d1255-1995-4b47-9913-c7c05bf3597a tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b554f95b7b4444ab70e9dabf8197de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fc732badb0488392694e6d6c67d5dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:11.846995 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-e96d1255-1995-4b47-9913-c7c05bf3597a tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d" status: 200 len: 1575 microversion: 2.1 time: 0.167397 Dec 15 16:27:11.858465 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 400/812] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:11 2021] GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:12.673700 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b37bd5d3-a73c-4f8b-925e-2fae704bc1d3 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:27:12.674727 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b37bd5d3-a73c-4f8b-925e-2fae704bc1d3 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:12.683005 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b37bd5d3-a73c-4f8b-925e-2fae704bc1d3 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:12.683495 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b37bd5d3-a73c-4f8b-925e-2fae704bc1d3 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:12.684294 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b37bd5d3-a73c-4f8b-925e-2fae704bc1d3 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:12.684726 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b37bd5d3-a73c-4f8b-925e-2fae704bc1d3 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:12.694310 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-38792e14-2aa1-490c-9501-8c8402628452 req-5dea20a2-0123-4acb-9260-d9355cfbf247 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afd5ac96-daf3-4608-818c-190e076c2f6d", "name": "network-vif-plugged", "status": "completed", "tag": "7f96dd5b-86e2-412f-920f-6abc632fd890"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:27:12.696564 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:27:12.696564 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Dec 15 16:27:12.704646 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-38792e14-2aa1-490c-9501-8c8402628452 req-5dea20a2-0123-4acb-9260-d9355cfbf247 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:12.705129 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-38792e14-2aa1-490c-9501-8c8402628452 req-5dea20a2-0123-4acb-9260-d9355cfbf247 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:12.718029 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-38792e14-2aa1-490c-9501-8c8402628452 req-5dea20a2-0123-4acb-9260-d9355cfbf247 service nova] Creating event network-vif-plugged:7f96dd5b-86e2-412f-920f-6abc632fd890 for instance afd5ac96-daf3-4608-818c-190e076c2f6d on hv-cinder-81268 Dec 15 16:27:12.723003 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-38792e14-2aa1-490c-9501-8c8402628452 req-5dea20a2-0123-4acb-9260-d9355cfbf247 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032532 Dec 15 16:27:12.723713 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 401/813] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:27:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:27:12.769382 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b37bd5d3-a73c-4f8b-925e-2fae704bc1d3 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action" status: 200 len: 27133 microversion: 2.1 time: 0.099469 Dec 15 16:27:12.770320 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 413/814] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:27:12 2021] POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action => generated 27133 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:27:12.866855 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-5fb19ebc-74fd-4f20-971f-1b012c7fd6a1 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:12.867558 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-5fb19ebc-74fd-4f20-971f-1b012c7fd6a1 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:12.874446 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5fb19ebc-74fd-4f20-971f-1b012c7fd6a1 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:12.874891 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5fb19ebc-74fd-4f20-971f-1b012c7fd6a1 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:12.875808 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5fb19ebc-74fd-4f20-971f-1b012c7fd6a1 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:12.876217 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5fb19ebc-74fd-4f20-971f-1b012c7fd6a1 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:13.024868 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-5fb19ebc-74fd-4f20-971f-1b012c7fd6a1 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b554f95b7b4444ab70e9dabf8197de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fc732badb0488392694e6d6c67d5dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:13.034168 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-5fb19ebc-74fd-4f20-971f-1b012c7fd6a1 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d" status: 200 len: 1575 microversion: 2.1 time: 0.171080 Dec 15 16:27:13.035017 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 402/815] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:12 2021] GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d => generated 1575 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:13.786319 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-4f729ec3-8170-49ec-8f8f-017502fe953b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:27:13.787563 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-4f729ec3-8170-49ec-8f8f-017502fe953b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:13.794688 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4f729ec3-8170-49ec-8f8f-017502fe953b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:13.795134 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4f729ec3-8170-49ec-8f8f-017502fe953b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:13.795939 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4f729ec3-8170-49ec-8f8f-017502fe953b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:13.796491 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4f729ec3-8170-49ec-8f8f-017502fe953b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:13.874392 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-4f729ec3-8170-49ec-8f8f-017502fe953b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action" status: 200 len: 27706 microversion: 2.1 time: 0.094995 Dec 15 16:27:13.875033 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 414/816] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:27:13 2021] POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action => generated 27706 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:14.052533 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-e4dc9a73-ecc0-4f94-b20b-0051d744e591 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:14.053208 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-e4dc9a73-ecc0-4f94-b20b-0051d744e591 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:14.059923 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e4dc9a73-ecc0-4f94-b20b-0051d744e591 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:14.060369 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e4dc9a73-ecc0-4f94-b20b-0051d744e591 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:14.061147 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e4dc9a73-ecc0-4f94-b20b-0051d744e591 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:14.061573 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e4dc9a73-ecc0-4f94-b20b-0051d744e591 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:14.209596 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-e4dc9a73-ecc0-4f94-b20b-0051d744e591 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b554f95b7b4444ab70e9dabf8197de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fc732badb0488392694e6d6c67d5dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:14.220573 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-e4dc9a73-ecc0-4f94-b20b-0051d744e591 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d" status: 200 len: 1575 microversion: 2.1 time: 0.171896 Dec 15 16:27:14.221337 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 403/817] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:14 2021] GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d => generated 1575 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:14.888850 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ebd5f4c2-d7ee-41e2-84bd-d03aade7c6a6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:27:14.890016 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ebd5f4c2-d7ee-41e2-84bd-d03aade7c6a6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:14.898411 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ebd5f4c2-d7ee-41e2-84bd-d03aade7c6a6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:14.898868 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ebd5f4c2-d7ee-41e2-84bd-d03aade7c6a6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:14.899696 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ebd5f4c2-d7ee-41e2-84bd-d03aade7c6a6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:14.900132 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ebd5f4c2-d7ee-41e2-84bd-d03aade7c6a6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:14.985198 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ebd5f4c2-d7ee-41e2-84bd-d03aade7c6a6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action" status: 200 len: 28064 microversion: 2.1 time: 0.101135 Dec 15 16:27:14.985836 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 415/818] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:27:14 2021] POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action => generated 28064 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:15.241754 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-5f94844d-3cb5-4c89-8f15-1af36fd4edc1 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:15.242345 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-5f94844d-3cb5-4c89-8f15-1af36fd4edc1 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:15.251997 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5f94844d-3cb5-4c89-8f15-1af36fd4edc1 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:15.252595 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5f94844d-3cb5-4c89-8f15-1af36fd4edc1 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:15.253815 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5f94844d-3cb5-4c89-8f15-1af36fd4edc1 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:15.254450 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5f94844d-3cb5-4c89-8f15-1af36fd4edc1 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:15.401208 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-5f94844d-3cb5-4c89-8f15-1af36fd4edc1 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b554f95b7b4444ab70e9dabf8197de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fc732badb0488392694e6d6c67d5dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:15.412920 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-5f94844d-3cb5-4c89-8f15-1af36fd4edc1 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d" status: 200 len: 1562 microversion: 2.1 time: 0.176954 Dec 15 16:27:15.413802 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 404/819] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:27:15 2021] GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d => generated 1562 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:15.997691 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-13c7bf89-df4f-4a6c-8cf9-5f93e1e5bf66 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:27:15.998722 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-13c7bf89-df4f-4a6c-8cf9-5f93e1e5bf66 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:16.006166 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-13c7bf89-df4f-4a6c-8cf9-5f93e1e5bf66 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:16.006614 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-13c7bf89-df4f-4a6c-8cf9-5f93e1e5bf66 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:16.007425 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-13c7bf89-df4f-4a6c-8cf9-5f93e1e5bf66 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:16.007851 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-13c7bf89-df4f-4a6c-8cf9-5f93e1e5bf66 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:16.091937 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-13c7bf89-df4f-4a6c-8cf9-5f93e1e5bf66 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action" status: 200 len: 28251 microversion: 2.1 time: 0.097685 Dec 15 16:27:16.092813 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 416/820] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:27:15 2021] POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action => generated 28251 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:17.106167 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-4a622ef4-5edd-49a5-8ada-204e67aa3ec9 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:27:17.107069 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-4a622ef4-5edd-49a5-8ada-204e67aa3ec9 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:17.114763 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4a622ef4-5edd-49a5-8ada-204e67aa3ec9 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:17.115606 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4a622ef4-5edd-49a5-8ada-204e67aa3ec9 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:17.116037 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4a622ef4-5edd-49a5-8ada-204e67aa3ec9 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:17.116462 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4a622ef4-5edd-49a5-8ada-204e67aa3ec9 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:17.185207 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-4a622ef4-5edd-49a5-8ada-204e67aa3ec9 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action" status: 200 len: 28251 microversion: 2.1 time: 0.082584 Dec 15 16:27:17.185915 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 405/821] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:27:17 2021] POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action => generated 28251 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:18.200657 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-a71ed5fd-776e-451c-a903-fbe9a48da10b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:27:18.201928 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-a71ed5fd-776e-451c-a903-fbe9a48da10b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:18.212850 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a71ed5fd-776e-451c-a903-fbe9a48da10b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:18.213477 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a71ed5fd-776e-451c-a903-fbe9a48da10b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:18.214670 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a71ed5fd-776e-451c-a903-fbe9a48da10b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:18.215283 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a71ed5fd-776e-451c-a903-fbe9a48da10b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:18.300252 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-a71ed5fd-776e-451c-a903-fbe9a48da10b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action" status: 200 len: 28542 microversion: 2.1 time: 0.106014 Dec 15 16:27:18.300898 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 417/822] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:27:18 2021] POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action => generated 28542 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:19.314164 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-b63c06f8-752e-4bd8-9fb2-8c042bdfb51c tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:27:19.315284 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-b63c06f8-752e-4bd8-9fb2-8c042bdfb51c tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:19.323213 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b63c06f8-752e-4bd8-9fb2-8c042bdfb51c tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:19.323696 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b63c06f8-752e-4bd8-9fb2-8c042bdfb51c tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:19.324504 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b63c06f8-752e-4bd8-9fb2-8c042bdfb51c tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:19.324943 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b63c06f8-752e-4bd8-9fb2-8c042bdfb51c tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:19.423253 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-b63c06f8-752e-4bd8-9fb2-8c042bdfb51c tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action" status: 200 len: 28710 microversion: 2.1 time: 0.112918 Dec 15 16:27:19.424087 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 406/823] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:27:19 2021] POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action => generated 28710 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:20.441579 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-4dc9e958-1474-44b5-a406-09ed1858a586 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:27:20.443287 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-4dc9e958-1474-44b5-a406-09ed1858a586 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:20.456020 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4dc9e958-1474-44b5-a406-09ed1858a586 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:20.456824 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4dc9e958-1474-44b5-a406-09ed1858a586 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:20.458258 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4dc9e958-1474-44b5-a406-09ed1858a586 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:20.459054 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4dc9e958-1474-44b5-a406-09ed1858a586 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:20.531287 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-4dc9e958-1474-44b5-a406-09ed1858a586 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action" status: 200 len: 28710 microversion: 2.1 time: 0.098950 Dec 15 16:27:20.531989 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 418/824] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:27:20 2021] POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action => generated 28710 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:21.555128 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-41d7ff19-b2e0-4703-a170-2d6d5de8ff34 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:27:21.556695 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-41d7ff19-b2e0-4703-a170-2d6d5de8ff34 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:21.564200 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-41d7ff19-b2e0-4703-a170-2d6d5de8ff34 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:21.564651 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-41d7ff19-b2e0-4703-a170-2d6d5de8ff34 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:21.565469 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-41d7ff19-b2e0-4703-a170-2d6d5de8ff34 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:21.565886 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-41d7ff19-b2e0-4703-a170-2d6d5de8ff34 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:21.633490 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-41d7ff19-b2e0-4703-a170-2d6d5de8ff34 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action" status: 200 len: 28710 microversion: 2.1 time: 0.084886 Dec 15 16:27:21.634695 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 407/825] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:27:21 2021] POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action => generated 28710 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:22.646788 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e1084efb-5e74-44d9-836f-69e7103a3aae tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:27:22.647927 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e1084efb-5e74-44d9-836f-69e7103a3aae tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:22.656213 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e1084efb-5e74-44d9-836f-69e7103a3aae tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:22.656704 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e1084efb-5e74-44d9-836f-69e7103a3aae tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:22.657603 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e1084efb-5e74-44d9-836f-69e7103a3aae tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:22.658046 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e1084efb-5e74-44d9-836f-69e7103a3aae tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:22.721865 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e1084efb-5e74-44d9-836f-69e7103a3aae tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action" status: 200 len: 28710 microversion: 2.1 time: 0.079470 Dec 15 16:27:22.722499 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 419/826] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:27:22 2021] POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action => generated 28710 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:23.740789 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-a562a06b-a604-49c0-82ed-031cc4a20f28 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:27:23.742055 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-a562a06b-a604-49c0-82ed-031cc4a20f28 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:23.749846 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a562a06b-a604-49c0-82ed-031cc4a20f28 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:23.750305 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a562a06b-a604-49c0-82ed-031cc4a20f28 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:23.751092 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a562a06b-a604-49c0-82ed-031cc4a20f28 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:23.751575 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a562a06b-a604-49c0-82ed-031cc4a20f28 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:23.830926 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-a562a06b-a604-49c0-82ed-031cc4a20f28 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action" status: 200 len: 30037 microversion: 2.1 time: 0.096822 Dec 15 16:27:23.832093 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 408/827] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:27:23 2021] POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action => generated 30037 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:24.846169 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-78b7aeb8-3919-46ae-b778-f5a348a73dd7 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:27:24.847175 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-78b7aeb8-3919-46ae-b778-f5a348a73dd7 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:24.854530 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-78b7aeb8-3919-46ae-b778-f5a348a73dd7 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:24.854978 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-78b7aeb8-3919-46ae-b778-f5a348a73dd7 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:24.855794 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-78b7aeb8-3919-46ae-b778-f5a348a73dd7 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:24.856231 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-78b7aeb8-3919-46ae-b778-f5a348a73dd7 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:24.933980 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-78b7aeb8-3919-46ae-b778-f5a348a73dd7 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action" status: 200 len: 31596 microversion: 2.1 time: 0.091769 Dec 15 16:27:24.934638 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 420/828] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:27:24 2021] POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action => generated 31596 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:25.947531 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-38844306-8a11-4306-9290-a32ab76ad8d7 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:27:25.948603 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-38844306-8a11-4306-9290-a32ab76ad8d7 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:25.956725 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-38844306-8a11-4306-9290-a32ab76ad8d7 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:25.957255 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-38844306-8a11-4306-9290-a32ab76ad8d7 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:25.958167 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-38844306-8a11-4306-9290-a32ab76ad8d7 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:25.958634 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-38844306-8a11-4306-9290-a32ab76ad8d7 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:26.038826 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-38844306-8a11-4306-9290-a32ab76ad8d7 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action" status: 200 len: 32832 microversion: 2.1 time: 0.095466 Dec 15 16:27:26.039846 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 409/829] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:27:25 2021] POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action => generated 32832 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:27.051197 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-55d9345c-352d-4dc2-960d-ca5bf7194386 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:27:27.052218 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-55d9345c-352d-4dc2-960d-ca5bf7194386 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:27.059470 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-55d9345c-352d-4dc2-960d-ca5bf7194386 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:27.059947 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-55d9345c-352d-4dc2-960d-ca5bf7194386 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:27.060695 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-55d9345c-352d-4dc2-960d-ca5bf7194386 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:27.061145 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-55d9345c-352d-4dc2-960d-ca5bf7194386 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:27.143398 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-55d9345c-352d-4dc2-960d-ca5bf7194386 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action" status: 200 len: 33474 microversion: 2.1 time: 0.095889 Dec 15 16:27:27.144063 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 421/830] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:27:27 2021] POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action => generated 33474 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:28.155910 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-31a74633-107b-45f4-abff-c42397e451f4 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:27:28.161197 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-31a74633-107b-45f4-abff-c42397e451f4 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:28.168913 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-31a74633-107b-45f4-abff-c42397e451f4 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:28.169365 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-31a74633-107b-45f4-abff-c42397e451f4 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:28.170160 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-31a74633-107b-45f4-abff-c42397e451f4 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:28.170594 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-31a74633-107b-45f4-abff-c42397e451f4 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:28.255905 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-31a74633-107b-45f4-abff-c42397e451f4 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action" status: 200 len: 34161 microversion: 2.1 time: 0.103925 Dec 15 16:27:28.256565 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 410/831] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:27:28 2021] POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action => generated 34161 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:29.269743 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b2511cbb-a484-40ee-89d8-7cb33e846dc5 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:27:29.270739 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b2511cbb-a484-40ee-89d8-7cb33e846dc5 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:29.278958 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b2511cbb-a484-40ee-89d8-7cb33e846dc5 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:29.279530 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b2511cbb-a484-40ee-89d8-7cb33e846dc5 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:29.280348 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b2511cbb-a484-40ee-89d8-7cb33e846dc5 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:29.280814 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b2511cbb-a484-40ee-89d8-7cb33e846dc5 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:29.358978 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b2511cbb-a484-40ee-89d8-7cb33e846dc5 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action" status: 200 len: 35290 microversion: 2.1 time: 0.093147 Dec 15 16:27:29.359683 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 422/832] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:27:29 2021] POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action => generated 35290 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:30.371248 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-69d45441-70ec-4c04-aa92-4df655e7da57 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:27:30.372273 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-69d45441-70ec-4c04-aa92-4df655e7da57 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:30.381205 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-69d45441-70ec-4c04-aa92-4df655e7da57 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:30.381645 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-69d45441-70ec-4c04-aa92-4df655e7da57 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:30.382438 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-69d45441-70ec-4c04-aa92-4df655e7da57 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:30.382855 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-69d45441-70ec-4c04-aa92-4df655e7da57 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:30.463009 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-69d45441-70ec-4c04-aa92-4df655e7da57 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action" status: 200 len: 36605 microversion: 2.1 time: 0.095643 Dec 15 16:27:30.463798 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 411/833] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:27:30 2021] POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action => generated 36605 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:31.476740 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-96174a65-d7f9-47b4-9733-288106cc51a4 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:27:31.477736 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-96174a65-d7f9-47b4-9733-288106cc51a4 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:31.485757 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-96174a65-d7f9-47b4-9733-288106cc51a4 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:31.486200 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-96174a65-d7f9-47b4-9733-288106cc51a4 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:31.486979 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-96174a65-d7f9-47b4-9733-288106cc51a4 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:31.487399 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-96174a65-d7f9-47b4-9733-288106cc51a4 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:31.575752 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-96174a65-d7f9-47b4-9733-288106cc51a4 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action" status: 200 len: 37867 microversion: 2.1 time: 0.102762 Dec 15 16:27:31.576331 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 423/834] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:27:31 2021] POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action => generated 37867 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:32.590243 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-4c1d331d-c066-4705-be0c-1559d4e20ad1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:27:32.591247 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-4c1d331d-c066-4705-be0c-1559d4e20ad1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:32.598611 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4c1d331d-c066-4705-be0c-1559d4e20ad1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:32.599062 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4c1d331d-c066-4705-be0c-1559d4e20ad1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:32.599895 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4c1d331d-c066-4705-be0c-1559d4e20ad1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:32.600327 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4c1d331d-c066-4705-be0c-1559d4e20ad1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:32.684674 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-4c1d331d-c066-4705-be0c-1559d4e20ad1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action" status: 200 len: 38238 microversion: 2.1 time: 0.099557 Dec 15 16:27:32.685348 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 412/835] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:27:32 2021] POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action => generated 38238 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:33.700948 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-76fe3948-4060-49c5-8456-522d75a8c0bf tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:27:33.701867 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-76fe3948-4060-49c5-8456-522d75a8c0bf tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:33.709325 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-76fe3948-4060-49c5-8456-522d75a8c0bf tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:33.709783 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-76fe3948-4060-49c5-8456-522d75a8c0bf tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:33.710566 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-76fe3948-4060-49c5-8456-522d75a8c0bf tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:33.710998 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-76fe3948-4060-49c5-8456-522d75a8c0bf tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:33.776181 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-76fe3948-4060-49c5-8456-522d75a8c0bf tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action" status: 200 len: 38238 microversion: 2.1 time: 0.080507 Dec 15 16:27:33.776817 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 424/836] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:27:33 2021] POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action => generated 38238 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:34.791855 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-bbaec40d-2618-48f0-8af6-ed27cb15d872 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:27:34.792867 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-bbaec40d-2618-48f0-8af6-ed27cb15d872 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:34.800491 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bbaec40d-2618-48f0-8af6-ed27cb15d872 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:34.800857 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bbaec40d-2618-48f0-8af6-ed27cb15d872 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:34.801646 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bbaec40d-2618-48f0-8af6-ed27cb15d872 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:34.802078 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bbaec40d-2618-48f0-8af6-ed27cb15d872 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:34.875838 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-bbaec40d-2618-48f0-8af6-ed27cb15d872 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action" status: 200 len: 38238 microversion: 2.1 time: 0.089967 Dec 15 16:27:34.876604 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 413/837] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:27:34 2021] POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action => generated 38238 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:35.889273 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-157c75b0-31b9-4fcb-906f-41cbc2cb9856 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:27:35.890300 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-157c75b0-31b9-4fcb-906f-41cbc2cb9856 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:35.897608 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-157c75b0-31b9-4fcb-906f-41cbc2cb9856 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:35.898008 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-157c75b0-31b9-4fcb-906f-41cbc2cb9856 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:35.898859 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-157c75b0-31b9-4fcb-906f-41cbc2cb9856 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:35.899274 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-157c75b0-31b9-4fcb-906f-41cbc2cb9856 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:35.975807 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-157c75b0-31b9-4fcb-906f-41cbc2cb9856 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action" status: 200 len: 38367 microversion: 2.1 time: 0.090357 Dec 15 16:27:35.976576 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 425/838] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:27:35 2021] POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/action => generated 38367 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 15 16:27:35.991072 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-c3dc4e5c-bca3-414c-a21e-b5e5f14ea1b0 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:35.991904 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-c3dc4e5c-bca3-414c-a21e-b5e5f14ea1b0 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:36.001469 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c3dc4e5c-bca3-414c-a21e-b5e5f14ea1b0 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:36.002053 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c3dc4e5c-bca3-414c-a21e-b5e5f14ea1b0 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:36.003278 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c3dc4e5c-bca3-414c-a21e-b5e5f14ea1b0 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:36.003843 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c3dc4e5c-bca3-414c-a21e-b5e5f14ea1b0 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:36.030390 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-c3dc4e5c-bca3-414c-a21e-b5e5f14ea1b0 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/ips" status: 200 len: 145 microversion: 2.1 time: 0.046285 Dec 15 16:27:36.031002 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 414/839] 10.222.0.60 () {58 vars in 1247 bytes} [Wed Dec 15 16:27:35 2021] GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/ips => generated 145 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:27:37.355118 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-60309170-e31f-4bcd-9004-34321e8b1a5c tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9cdb5905-03f0-4c8b-b049-e516264b8dae"}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:27:37.356319 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-60309170-e31f-4bcd-9004-34321e8b1a5c tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:37.363844 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-60309170-e31f-4bcd-9004-34321e8b1a5c tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:37.364301 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-60309170-e31f-4bcd-9004-34321e8b1a5c tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:37.365078 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-60309170-e31f-4bcd-9004-34321e8b1a5c tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:37.365486 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-60309170-e31f-4bcd-9004-34321e8b1a5c tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:37.629499 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-60309170-e31f-4bcd-9004-34321e8b1a5c tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278603 Dec 15 16:27:37.630142 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 426/840] 10.222.0.60 () {60 vars in 1322 bytes} [Wed Dec 15 16:27:37 2021] POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:27:38.458893 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-b33bc704-2557-4cd6-b5e4-6ccc72d4a9a8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:38.459487 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-b33bc704-2557-4cd6-b5e4-6ccc72d4a9a8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:38.466209 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b33bc704-2557-4cd6-b5e4-6ccc72d4a9a8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:38.466670 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b33bc704-2557-4cd6-b5e4-6ccc72d4a9a8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:38.467482 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b33bc704-2557-4cd6-b5e4-6ccc72d4a9a8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:38.467920 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b33bc704-2557-4cd6-b5e4-6ccc72d4a9a8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:38.498194 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-b33bc704-2557-4cd6-b5e4-6ccc72d4a9a8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/os-volume_attachments/1715dbbd-bf71-4f87-afed-f1b6389838c0" status: 200 len: 194 microversion: 2.20 time: 0.043268 Dec 15 16:27:38.498792 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 415/841] 10.222.0.60 () {60 vars in 1453 bytes} [Wed Dec 15 16:27:38 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/os-volume_attachments/1715dbbd-bf71-4f87-afed-f1b6389838c0 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:38.561552 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0ac5c7d3-4e6d-4840-af0f-e55368823308 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:38.562115 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-0ac5c7d3-4e6d-4840-af0f-e55368823308 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:38.568541 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0ac5c7d3-4e6d-4840-af0f-e55368823308 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:38.568987 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0ac5c7d3-4e6d-4840-af0f-e55368823308 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:38.569769 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0ac5c7d3-4e6d-4840-af0f-e55368823308 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:38.570195 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0ac5c7d3-4e6d-4840-af0f-e55368823308 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:38.664145 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.objects.instance [None req-0ac5c7d3-4e6d-4840-af0f-e55368823308 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lazy-loading 'services' on Instance uuid 049761b5-88eb-4325-af0e-03da2842cbf5 {{(pid=116084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:27:38.745532 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0ac5c7d3-4e6d-4840-af0f-e55368823308 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "DELETE /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/os-volume_attachments/1715dbbd-bf71-4f87-afed-f1b6389838c0" status: 202 len: 0 microversion: 2.20 time: 0.188825 Dec 15 16:27:38.746251 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 427/842] 10.222.0.60 () {60 vars in 1456 bytes} [Wed Dec 15 16:27:38 2021] DELETE /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/os-volume_attachments/1715dbbd-bf71-4f87-afed-f1b6389838c0 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:27:38.754781 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-a485bd31-af3a-472c-97f6-08832622bbcd tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:38.755737 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-a485bd31-af3a-472c-97f6-08832622bbcd tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:38.762489 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a485bd31-af3a-472c-97f6-08832622bbcd tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:38.763149 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a485bd31-af3a-472c-97f6-08832622bbcd tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:38.764107 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a485bd31-af3a-472c-97f6-08832622bbcd tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:38.764716 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a485bd31-af3a-472c-97f6-08832622bbcd tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:38.796623 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-a485bd31-af3a-472c-97f6-08832622bbcd tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045753 Dec 15 16:27:38.797194 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 416/843] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:38 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:39.811086 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-26ed331e-bb87-4656-a593-6abcaf329276 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:39.812160 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-26ed331e-bb87-4656-a593-6abcaf329276 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:39.821682 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-26ed331e-bb87-4656-a593-6abcaf329276 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:39.822314 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-26ed331e-bb87-4656-a593-6abcaf329276 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:39.823490 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-26ed331e-bb87-4656-a593-6abcaf329276 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:39.823934 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-26ed331e-bb87-4656-a593-6abcaf329276 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:39.854165 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-26ed331e-bb87-4656-a593-6abcaf329276 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047754 Dec 15 16:27:39.854757 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 428/844] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:39 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:40.866955 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-8d5308d1-5a41-4fda-b27d-2278f1fd579f tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:40.867888 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-8d5308d1-5a41-4fda-b27d-2278f1fd579f tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:40.875123 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8d5308d1-5a41-4fda-b27d-2278f1fd579f tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:40.875593 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8d5308d1-5a41-4fda-b27d-2278f1fd579f tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:40.876367 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8d5308d1-5a41-4fda-b27d-2278f1fd579f tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:40.876792 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8d5308d1-5a41-4fda-b27d-2278f1fd579f tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:40.907401 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-8d5308d1-5a41-4fda-b27d-2278f1fd579f tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044188 Dec 15 16:27:40.907965 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 417/845] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:40 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:41.920263 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-cd6a28b3-b028-4cc4-bf7f-cfb8795e9a9f tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:41.921182 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-cd6a28b3-b028-4cc4-bf7f-cfb8795e9a9f tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:41.928424 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cd6a28b3-b028-4cc4-bf7f-cfb8795e9a9f tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:41.928890 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cd6a28b3-b028-4cc4-bf7f-cfb8795e9a9f tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:41.929662 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cd6a28b3-b028-4cc4-bf7f-cfb8795e9a9f tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:41.930102 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cd6a28b3-b028-4cc4-bf7f-cfb8795e9a9f tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:41.963275 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-cd6a28b3-b028-4cc4-bf7f-cfb8795e9a9f tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046870 Dec 15 16:27:41.963878 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 429/846] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:41 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:42.974944 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-87a91ed6-5cf3-47cf-b354-76f4b327d6dd tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:42.975905 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-87a91ed6-5cf3-47cf-b354-76f4b327d6dd tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:42.983654 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-87a91ed6-5cf3-47cf-b354-76f4b327d6dd tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:42.984559 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-87a91ed6-5cf3-47cf-b354-76f4b327d6dd tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:42.985355 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-87a91ed6-5cf3-47cf-b354-76f4b327d6dd tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:42.985789 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-87a91ed6-5cf3-47cf-b354-76f4b327d6dd tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:43.017200 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-87a91ed6-5cf3-47cf-b354-76f4b327d6dd tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045937 Dec 15 16:27:43.017788 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 418/847] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:42 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:44.028969 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c211e592-ebbe-4102-9632-b234ca07b987 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:44.030853 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c211e592-ebbe-4102-9632-b234ca07b987 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:44.037619 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c211e592-ebbe-4102-9632-b234ca07b987 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:44.038070 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c211e592-ebbe-4102-9632-b234ca07b987 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:44.038871 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c211e592-ebbe-4102-9632-b234ca07b987 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:44.039306 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c211e592-ebbe-4102-9632-b234ca07b987 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:44.071601 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c211e592-ebbe-4102-9632-b234ca07b987 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046528 Dec 15 16:27:44.075847 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 430/848] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:44 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:27:45.083831 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-21a7871b-c720-48aa-8db8-3c238551b196 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:45.084758 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-21a7871b-c720-48aa-8db8-3c238551b196 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:45.091439 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-21a7871b-c720-48aa-8db8-3c238551b196 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:45.091927 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-21a7871b-c720-48aa-8db8-3c238551b196 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:45.092725 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-21a7871b-c720-48aa-8db8-3c238551b196 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:45.093152 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-21a7871b-c720-48aa-8db8-3c238551b196 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:45.123080 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-21a7871b-c720-48aa-8db8-3c238551b196 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043707 Dec 15 16:27:45.123703 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 419/849] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Dec 15 16:27:45 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:27:45.135452 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e0ba5385-4f47-409f-8080-cb3bb82a3d94 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:45.136363 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e0ba5385-4f47-409f-8080-cb3bb82a3d94 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:45.142843 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e0ba5385-4f47-409f-8080-cb3bb82a3d94 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:45.143291 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e0ba5385-4f47-409f-8080-cb3bb82a3d94 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:45.144098 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e0ba5385-4f47-409f-8080-cb3bb82a3d94 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:45.144530 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e0ba5385-4f47-409f-8080-cb3bb82a3d94 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:45.176087 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e0ba5385-4f47-409f-8080-cb3bb82a3d94 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044499 Dec 15 16:27:45.176687 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 431/850] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Dec 15 16:27:45 2021] GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:27:45.179982 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-2cfa2a64-e7cc-46c5-80bd-5921fd1245f5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:45.180486 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-2cfa2a64-e7cc-46c5-80bd-5921fd1245f5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:45.185920 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-43ed4502-17ab-4528-9cfe-07e4068636c1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:45.186404 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-43ed4502-17ab-4528-9cfe-07e4068636c1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:45.186567 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2cfa2a64-e7cc-46c5-80bd-5921fd1245f5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:45.186972 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2cfa2a64-e7cc-46c5-80bd-5921fd1245f5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:45.187781 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2cfa2a64-e7cc-46c5-80bd-5921fd1245f5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:45.188217 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2cfa2a64-e7cc-46c5-80bd-5921fd1245f5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:45.192147 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-43ed4502-17ab-4528-9cfe-07e4068636c1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:45.192598 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-43ed4502-17ab-4528-9cfe-07e4068636c1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:45.193384 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-43ed4502-17ab-4528-9cfe-07e4068636c1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:45.193820 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-43ed4502-17ab-4528-9cfe-07e4068636c1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:45.215826 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-2cfa2a64-e7cc-46c5-80bd-5921fd1245f5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Going to try to terminate instance {{(pid=116085) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:27:45.222755 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-43ed4502-17ab-4528-9cfe-07e4068636c1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/os-volume_attachments/9cdb5905-03f0-4c8b-b049-e516264b8dae" status: 200 len: 194 microversion: 2.1 time: 0.040326 Dec 15 16:27:45.223329 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 432/851] 10.222.0.60 () {58 vars in 1412 bytes} [Wed Dec 15 16:27:45 2021] GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/os-volume_attachments/9cdb5905-03f0-4c8b-b049-e516264b8dae => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:27:45.297780 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-2cfa2a64-e7cc-46c5-80bd-5921fd1245f5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "DELETE /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 204 len: 0 microversion: 2.20 time: 0.121158 Dec 15 16:27:45.298468 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 420/852] 10.222.0.60 () {60 vars in 1279 bytes} [Wed Dec 15 16:27:45 2021] DELETE /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Dec 15 16:27:45.307342 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-3db8251b-e6e2-47e0-bb15-be35a55fc7bf tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:45.307975 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-3db8251b-e6e2-47e0-bb15-be35a55fc7bf tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:45.314529 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3db8251b-e6e2-47e0-bb15-be35a55fc7bf tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:45.315493 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3db8251b-e6e2-47e0-bb15-be35a55fc7bf tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:45.316361 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3db8251b-e6e2-47e0-bb15-be35a55fc7bf tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:45.316786 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3db8251b-e6e2-47e0-bb15-be35a55fc7bf tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:45.476684 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-3db8251b-e6e2-47e0-bb15-be35a55fc7bf tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:45.485828 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-3db8251b-e6e2-47e0-bb15-be35a55fc7bf tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:45.487362 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-3db8251b-e6e2-47e0-bb15-be35a55fc7bf tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:45.488602 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-3db8251b-e6e2-47e0-bb15-be35a55fc7bf tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1722 microversion: 2.20 time: 0.185154 Dec 15 16:27:45.489177 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 433/853] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:27:45 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:27:46.509286 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-04dcf9dc-7185-4c5e-897d-4ae086a159a5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:46.509893 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-04dcf9dc-7185-4c5e-897d-4ae086a159a5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:46.516755 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-04dcf9dc-7185-4c5e-897d-4ae086a159a5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:46.517217 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-04dcf9dc-7185-4c5e-897d-4ae086a159a5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:46.518384 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-04dcf9dc-7185-4c5e-897d-4ae086a159a5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:46.518514 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-04dcf9dc-7185-4c5e-897d-4ae086a159a5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:46.567574 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-62f33a16-6ce6-4751-82e3-9f62b3c99db8 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "132008e8-3757-4006-b666-41870a78409b"}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:27:46.568700 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-62f33a16-6ce6-4751-82e3-9f62b3c99db8 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:46.577563 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-62f33a16-6ce6-4751-82e3-9f62b3c99db8 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:46.578016 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-62f33a16-6ce6-4751-82e3-9f62b3c99db8 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:46.578864 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-62f33a16-6ce6-4751-82e3-9f62b3c99db8 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:46.579299 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-62f33a16-6ce6-4751-82e3-9f62b3c99db8 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:46.662412 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-04dcf9dc-7185-4c5e-897d-4ae086a159a5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:46.673713 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-04dcf9dc-7185-4c5e-897d-4ae086a159a5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:46.675394 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-04dcf9dc-7185-4c5e-897d-4ae086a159a5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:46.676796 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-04dcf9dc-7185-4c5e-897d-4ae086a159a5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1722 microversion: 2.20 time: 0.171832 Dec 15 16:27:46.677396 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 421/854] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:27:46 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:27:46.836581 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-62f33a16-6ce6-4751-82e3-9f62b3c99db8 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273311 Dec 15 16:27:46.837213 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 434/855] 10.222.0.60 () {60 vars in 1322 bytes} [Wed Dec 15 16:27:46 2021] POST /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:27:47.697122 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-7f0f2708-5178-46c4-b00d-53eb5f8d5637 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:47.697697 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-7f0f2708-5178-46c4-b00d-53eb5f8d5637 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:47.704570 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7f0f2708-5178-46c4-b00d-53eb5f8d5637 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:47.705789 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7f0f2708-5178-46c4-b00d-53eb5f8d5637 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:47.706787 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7f0f2708-5178-46c4-b00d-53eb5f8d5637 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:47.707210 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7f0f2708-5178-46c4-b00d-53eb5f8d5637 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:47.771255 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-7f0f2708-5178-46c4-b00d-53eb5f8d5637 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:47.780193 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-7f0f2708-5178-46c4-b00d-53eb5f8d5637 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:47.785062 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-7f0f2708-5178-46c4-b00d-53eb5f8d5637 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:47.785062 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-7f0f2708-5178-46c4-b00d-53eb5f8d5637 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 200 len: 1655 microversion: 2.20 time: 0.089631 Dec 15 16:27:47.785062 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 422/856] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:27:47 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 1655 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:27:47.838136 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-f3593724-d08e-455c-90ef-adf96be54947 req-2ed43485-2406-41a6-b502-e13ddebc1473 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "049761b5-88eb-4325-af0e-03da2842cbf5", "name": "network-vif-deleted", "tag": "71e495aa-7e03-4d0e-9f9d-b7560a684e27"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:27:47.839873 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:27:47.839873 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:27:47.850638 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-f3593724-d08e-455c-90ef-adf96be54947 req-2ed43485-2406-41a6-b502-e13ddebc1473 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:47.851314 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-f3593724-d08e-455c-90ef-adf96be54947 req-2ed43485-2406-41a6-b502-e13ddebc1473 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:47.878663 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-f3593724-d08e-455c-90ef-adf96be54947 req-2ed43485-2406-41a6-b502-e13ddebc1473 service nova] Creating event network-vif-deleted:71e495aa-7e03-4d0e-9f9d-b7560a684e27 for instance 049761b5-88eb-4325-af0e-03da2842cbf5 on hv-cinder-81268 Dec 15 16:27:47.884711 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-f3593724-d08e-455c-90ef-adf96be54947 req-2ed43485-2406-41a6-b502-e13ddebc1473 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050748 Dec 15 16:27:47.885327 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 435/857] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:27:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:27:48.803758 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-6966f21e-d8ba-4199-a518-3d1d0a9db5fc tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:48.804340 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-6966f21e-d8ba-4199-a518-3d1d0a9db5fc tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:48.811316 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6966f21e-d8ba-4199-a518-3d1d0a9db5fc tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:48.811759 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6966f21e-d8ba-4199-a518-3d1d0a9db5fc tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:48.812571 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6966f21e-d8ba-4199-a518-3d1d0a9db5fc tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:48.813003 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6966f21e-d8ba-4199-a518-3d1d0a9db5fc tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:48.828364 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.wsgi [None req-6966f21e-d8ba-4199-a518-3d1d0a9db5fc tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] HTTP exception thrown: Instance 049761b5-88eb-4325-af0e-03da2842cbf5 could not be found. Dec 15 16:27:48.828968 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-6966f21e-d8ba-4199-a518-3d1d0a9db5fc tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Returning 404 to user: Instance 049761b5-88eb-4325-af0e-03da2842cbf5 could not be found. {{(pid=116085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:27:48.829845 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-6966f21e-d8ba-4199-a518-3d1d0a9db5fc tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 404 len: 111 microversion: 2.20 time: 0.030013 Dec 15 16:27:48.830428 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 423/858] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:27:48 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 16:27:48.840830 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-647a841f-21d2-4bfc-8c89-ef1ffee2bdb6 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '.version_select at 0x7f0b2697a280>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:48.865033 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-647a841f-21d2-4bfc-8c89-ef1ffee2bdb6 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-888932254" status: 204 len: 0 microversion: 2.20 time: 0.028835 Dec 15 16:27:48.865632 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 436/859] 10.222.0.60 () {60 vars in 1258 bytes} [Wed Dec 15 16:27:48 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-888932254 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 15 16:27:49.573877 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-1c627136-e42d-43ba-b51f-89401ebe0ba8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'create', calling method: .version_select at 0x7f0b269d44c0>, body: {"keypair": {"name": "tempest-keypair-1916099149"}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:27:49.589572 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-1c627136-e42d-43ba-b51f-89401ebe0ba8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Getting quotas for project 9dc6fd27025742699d14dbf14680c7c3. Resources: {'key_pairs'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:27:49.593861 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-1c627136-e42d-43ba-b51f-89401ebe0ba8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Getting quotas for user 4a7cfeb030104d338be8575f10d8ec68 and project 9dc6fd27025742699d14dbf14680c7c3. Resources: {'key_pairs'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:27:49.839563 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-1c627136-e42d-43ba-b51f-89401ebe0ba8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Getting quotas for project 9dc6fd27025742699d14dbf14680c7c3. Resources: {'key_pairs'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:27:49.845455 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-1c627136-e42d-43ba-b51f-89401ebe0ba8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Getting quotas for user 4a7cfeb030104d338be8575f10d8ec68 and project 9dc6fd27025742699d14dbf14680c7c3. Resources: {'key_pairs'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:27:49.864451 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-1c627136-e42d-43ba-b51f-89401ebe0ba8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.294603 Dec 15 16:27:49.865040 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 424/860] 10.222.0.60 () {62 vars in 1198 bytes} [Wed Dec 15 16:27:49 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 296 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 15 16:27:51.213695 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b2d30ce3-b5e3-422b-a63b-cdac0bc87e00 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1652947457", "imageRef": "b72b5f54-34d0-48ac-9484-bc8104a6dddb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "89d58e9b-0fd5-43aa-b277-d040a9af8bd8"}], "security_groups": [{"name": "tempest-securitygroup--1983119332"}], "key_name": "tempest-keypair-1916099149", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:27:51.325380 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.network.neutron [None req-b2d30ce3-b5e3-422b-a63b-cdac0bc87e00 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] validate_networks() for [('89d58e9b-0fd5-43aa-b277-d040a9af8bd8', None, None, None, None, None)] {{(pid=116084) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:27:51.731887 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-b2d30ce3-b5e3-422b-a63b-cdac0bc87e00 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Flavor limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:27:51.732308 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-b2d30ce3-b5e3-422b-a63b-cdac0bc87e00 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Image limits 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:27:51.732890 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-b2d30ce3-b5e3-422b-a63b-cdac0bc87e00 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Flavor pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:27:51.733292 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-b2d30ce3-b5e3-422b-a63b-cdac0bc87e00 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Image pref 0:0:0 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:27:51.733697 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.virt.hardware [None req-b2d30ce3-b5e3-422b-a63b-cdac0bc87e00 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:27:51.744053 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b2d30ce3-b5e3-422b-a63b-cdac0bc87e00 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:51.744497 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b2d30ce3-b5e3-422b-a63b-cdac0bc87e00 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:51.745303 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b2d30ce3-b5e3-422b-a63b-cdac0bc87e00 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:51.745734 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b2d30ce3-b5e3-422b-a63b-cdac0bc87e00 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:51.764224 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-b2d30ce3-b5e3-422b-a63b-cdac0bc87e00 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Getting quotas for project 9dc6fd27025742699d14dbf14680c7c3. Resources: {'cores', 'instances', 'ram'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:27:51.768525 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-b2d30ce3-b5e3-422b-a63b-cdac0bc87e00 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Getting quotas for user 4a7cfeb030104d338be8575f10d8ec68 and project 9dc6fd27025742699d14dbf14680c7c3. Resources: {'cores', 'instances', 'ram'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:27:51.780461 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b2d30ce3-b5e3-422b-a63b-cdac0bc87e00 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Going to run 1 instances... {{(pid=116084) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:27:51.782894 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b2d30ce3-b5e3-422b-a63b-cdac0bc87e00 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b72b5f54-34d0-48ac-9484-bc8104a6dddb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116084) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:27:51.833354 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b2d30ce3-b5e3-422b-a63b-cdac0bc87e00 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.624187 Dec 15 16:27:51.834004 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 437/861] 10.222.0.60 () {62 vars in 1187 bytes} [Wed Dec 15 16:27:51 2021] POST /compute/v2.1/servers => generated 402 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 15 16:27:51.845418 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-f74e44bf-0ded-4409-ad1c-54de6cb3f19e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:51.846017 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-f74e44bf-0ded-4409-ad1c-54de6cb3f19e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:51.912030 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-f74e44bf-0ded-4409-ad1c-54de6cb3f19e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:51.920810 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-f74e44bf-0ded-4409-ad1c-54de6cb3f19e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:51.922345 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-f74e44bf-0ded-4409-ad1c-54de6cb3f19e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:51.923484 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-f74e44bf-0ded-4409-ad1c-54de6cb3f19e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 200 len: 1282 microversion: 2.20 time: 0.082308 Dec 15 16:27:51.924039 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 425/862] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:27:51 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 1282 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:27:52.944305 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-2f952a6f-3bad-4a6c-97ec-4622d5c7cc9d tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:52.945066 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-2f952a6f-3bad-4a6c-97ec-4622d5c7cc9d tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:52.952421 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2f952a6f-3bad-4a6c-97ec-4622d5c7cc9d tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:52.953519 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2f952a6f-3bad-4a6c-97ec-4622d5c7cc9d tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:52.954398 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2f952a6f-3bad-4a6c-97ec-4622d5c7cc9d tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:52.955182 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2f952a6f-3bad-4a6c-97ec-4622d5c7cc9d tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:53.024142 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-2f952a6f-3bad-4a6c-97ec-4622d5c7cc9d tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:53.033165 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-2f952a6f-3bad-4a6c-97ec-4622d5c7cc9d tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:53.034863 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-2f952a6f-3bad-4a6c-97ec-4622d5c7cc9d tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:53.036031 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-2f952a6f-3bad-4a6c-97ec-4622d5c7cc9d tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 200 len: 1340 microversion: 2.20 time: 0.096434 Dec 15 16:27:53.036604 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 438/863] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:27:52 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 1340 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:27:54.054124 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-37b0d7bf-63d1-4669-b0e6-deeec1299360 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:54.054726 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-37b0d7bf-63d1-4669-b0e6-deeec1299360 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:54.062419 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-37b0d7bf-63d1-4669-b0e6-deeec1299360 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:54.063230 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-37b0d7bf-63d1-4669-b0e6-deeec1299360 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:54.064835 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-37b0d7bf-63d1-4669-b0e6-deeec1299360 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:54.065452 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-37b0d7bf-63d1-4669-b0e6-deeec1299360 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:54.210035 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-37b0d7bf-63d1-4669-b0e6-deeec1299360 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:54.218379 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-37b0d7bf-63d1-4669-b0e6-deeec1299360 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:54.219930 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-37b0d7bf-63d1-4669-b0e6-deeec1299360 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:54.221601 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-37b0d7bf-63d1-4669-b0e6-deeec1299360 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 200 len: 1408 microversion: 2.20 time: 0.170785 Dec 15 16:27:54.222307 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 426/864] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:27:54 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 1408 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:27:54.239558 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-7088b8db-5456-41f2-9243-e09ba430f37b req-314607d4-5c5d-4ac1-b513-836e51ce8350 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfff70d8-7b03-417e-886b-1929e47645d5", "tag": "2e6e772a-f992-461a-881b-dffbf851deca"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:27:54.241356 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:27:54.241356 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:27:54.250383 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-7088b8db-5456-41f2-9243-e09ba430f37b req-314607d4-5c5d-4ac1-b513-836e51ce8350 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:54.251065 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-7088b8db-5456-41f2-9243-e09ba430f37b req-314607d4-5c5d-4ac1-b513-836e51ce8350 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:54.272547 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-7088b8db-5456-41f2-9243-e09ba430f37b req-314607d4-5c5d-4ac1-b513-836e51ce8350 service nova] Creating event network-changed:2e6e772a-f992-461a-881b-dffbf851deca for instance bfff70d8-7b03-417e-886b-1929e47645d5 on hv-cinder-81268 Dec 15 16:27:54.290884 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-7088b8db-5456-41f2-9243-e09ba430f37b req-314607d4-5c5d-4ac1-b513-836e51ce8350 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068154 Dec 15 16:27:54.292804 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 439/865] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:27:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:27:54.378686 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-7f96c1d3-5f2a-4255-934f-6a7f3a6085db tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:54.379705 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-7f96c1d3-5f2a-4255-934f-6a7f3a6085db tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:54.386097 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7f96c1d3-5f2a-4255-934f-6a7f3a6085db tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:54.386554 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7f96c1d3-5f2a-4255-934f-6a7f3a6085db tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:54.387353 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7f96c1d3-5f2a-4255-934f-6a7f3a6085db tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:54.387819 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7f96c1d3-5f2a-4255-934f-6a7f3a6085db tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:54.420218 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-7f96c1d3-5f2a-4255-934f-6a7f3a6085db tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045331 Dec 15 16:27:54.425160 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 427/866] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Dec 15 16:27:54 2021] GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:27:55.242268 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-5a7c5b56-0888-4337-b384-11d246aa9fd6 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:55.242995 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-5a7c5b56-0888-4337-b384-11d246aa9fd6 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:55.249309 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5a7c5b56-0888-4337-b384-11d246aa9fd6 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:55.249762 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5a7c5b56-0888-4337-b384-11d246aa9fd6 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:55.250548 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5a7c5b56-0888-4337-b384-11d246aa9fd6 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:55.250984 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5a7c5b56-0888-4337-b384-11d246aa9fd6 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:55.410065 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-5a7c5b56-0888-4337-b384-11d246aa9fd6 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:55.418098 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-5a7c5b56-0888-4337-b384-11d246aa9fd6 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:55.419624 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-5a7c5b56-0888-4337-b384-11d246aa9fd6 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:55.420738 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-5a7c5b56-0888-4337-b384-11d246aa9fd6 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 200 len: 1408 microversion: 2.20 time: 0.182684 Dec 15 16:27:55.421345 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 440/867] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:27:55 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 1408 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:27:56.439770 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-6401e2a4-8098-4dd7-affa-492bb65aebb5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:56.440412 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-6401e2a4-8098-4dd7-affa-492bb65aebb5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:56.447229 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6401e2a4-8098-4dd7-affa-492bb65aebb5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:56.447721 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6401e2a4-8098-4dd7-affa-492bb65aebb5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:56.448511 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6401e2a4-8098-4dd7-affa-492bb65aebb5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:56.448945 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6401e2a4-8098-4dd7-affa-492bb65aebb5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:56.595144 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-6401e2a4-8098-4dd7-affa-492bb65aebb5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:56.603816 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-6401e2a4-8098-4dd7-affa-492bb65aebb5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:56.605308 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-6401e2a4-8098-4dd7-affa-492bb65aebb5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:56.606412 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-6401e2a4-8098-4dd7-affa-492bb65aebb5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 200 len: 1408 microversion: 2.20 time: 0.170516 Dec 15 16:27:56.606986 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 428/868] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:27:56 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 1408 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:27:57.625489 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-6ba46d2b-b0be-43e0-af2c-5fc052c119c0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:57.626059 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-6ba46d2b-b0be-43e0-af2c-5fc052c119c0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:57.633320 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6ba46d2b-b0be-43e0-af2c-5fc052c119c0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:57.633762 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6ba46d2b-b0be-43e0-af2c-5fc052c119c0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:57.634543 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6ba46d2b-b0be-43e0-af2c-5fc052c119c0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:57.634974 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6ba46d2b-b0be-43e0-af2c-5fc052c119c0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:57.791077 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-6ba46d2b-b0be-43e0-af2c-5fc052c119c0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:57.803276 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-6ba46d2b-b0be-43e0-af2c-5fc052c119c0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:57.805600 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-6ba46d2b-b0be-43e0-af2c-5fc052c119c0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:57.807240 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-6ba46d2b-b0be-43e0-af2c-5fc052c119c0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 200 len: 1408 microversion: 2.20 time: 0.185475 Dec 15 16:27:57.808131 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 441/869] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:27:57 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 1408 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:27:58.829268 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-8eec0c28-e1b0-499f-a9c2-b62514221dad tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:27:58.829875 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-8eec0c28-e1b0-499f-a9c2-b62514221dad tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:27:58.837254 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8eec0c28-e1b0-499f-a9c2-b62514221dad tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:58.837701 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8eec0c28-e1b0-499f-a9c2-b62514221dad tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:58.838486 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8eec0c28-e1b0-499f-a9c2-b62514221dad tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:58.838918 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8eec0c28-e1b0-499f-a9c2-b62514221dad tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:58.938213 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-16548290-5a47-4ecf-8e17-a39a15e47d1c req-aa1f955e-1cf1-41ac-997b-4962d2fb91bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfff70d8-7b03-417e-886b-1929e47645d5", "name": "network-vif-plugged", "status": "completed", "tag": "2e6e772a-f992-461a-881b-dffbf851deca"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:27:58.939873 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:27:58.939873 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:27:58.948662 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-16548290-5a47-4ecf-8e17-a39a15e47d1c req-aa1f955e-1cf1-41ac-997b-4962d2fb91bf service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:27:58.949065 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-16548290-5a47-4ecf-8e17-a39a15e47d1c req-aa1f955e-1cf1-41ac-997b-4962d2fb91bf service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:27:58.961997 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-16548290-5a47-4ecf-8e17-a39a15e47d1c req-aa1f955e-1cf1-41ac-997b-4962d2fb91bf service nova] Creating event network-vif-plugged:2e6e772a-f992-461a-881b-dffbf851deca for instance bfff70d8-7b03-417e-886b-1929e47645d5 on hv-cinder-81268 Dec 15 16:27:58.967050 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-16548290-5a47-4ecf-8e17-a39a15e47d1c req-aa1f955e-1cf1-41ac-997b-4962d2fb91bf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032540 Dec 15 16:27:58.967947 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 442/870] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:27:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:27:58.977023 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-8eec0c28-e1b0-499f-a9c2-b62514221dad tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:58.985842 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-8eec0c28-e1b0-499f-a9c2-b62514221dad tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:58.987350 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-8eec0c28-e1b0-499f-a9c2-b62514221dad tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:27:58.988475 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-8eec0c28-e1b0-499f-a9c2-b62514221dad tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 200 len: 1408 microversion: 2.20 time: 0.163146 Dec 15 16:27:58.989029 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 429/871] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:27:58 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:28:00.007614 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1beb4d82-6d64-452d-a02a-a08237f6f825 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:00.008264 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1beb4d82-6d64-452d-a02a-a08237f6f825 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:00.014749 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1beb4d82-6d64-452d-a02a-a08237f6f825 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:00.015189 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1beb4d82-6d64-452d-a02a-a08237f6f825 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:00.015975 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1beb4d82-6d64-452d-a02a-a08237f6f825 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:00.016396 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1beb4d82-6d64-452d-a02a-a08237f6f825 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:00.159986 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1beb4d82-6d64-452d-a02a-a08237f6f825 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:00.172604 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1beb4d82-6d64-452d-a02a-a08237f6f825 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:00.174860 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1beb4d82-6d64-452d-a02a-a08237f6f825 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:00.176646 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1beb4d82-6d64-452d-a02a-a08237f6f825 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 200 len: 1408 microversion: 2.20 time: 0.173504 Dec 15 16:28:00.177508 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 443/872] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:28:00 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 1408 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:28:01.197626 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-44783b83-7e3e-461d-9392-6b5cf03522fe tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:01.198249 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-44783b83-7e3e-461d-9392-6b5cf03522fe tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:01.205531 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-44783b83-7e3e-461d-9392-6b5cf03522fe tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:01.206181 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-44783b83-7e3e-461d-9392-6b5cf03522fe tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:01.206968 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-44783b83-7e3e-461d-9392-6b5cf03522fe tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:01.207401 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-44783b83-7e3e-461d-9392-6b5cf03522fe tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:01.560180 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-44783b83-7e3e-461d-9392-6b5cf03522fe tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:01.568922 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-44783b83-7e3e-461d-9392-6b5cf03522fe tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:01.570419 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-44783b83-7e3e-461d-9392-6b5cf03522fe tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:01.571645 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-44783b83-7e3e-461d-9392-6b5cf03522fe tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 200 len: 1600 microversion: 2.20 time: 0.378849 Dec 15 16:28:01.572180 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 430/873] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:28:01 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 1600 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:28:01.589519 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-80637cea-5342-4f00-8d6b-55f2a587624e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:01.590090 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-80637cea-5342-4f00-8d6b-55f2a587624e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:01.596873 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-80637cea-5342-4f00-8d6b-55f2a587624e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:01.597314 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-80637cea-5342-4f00-8d6b-55f2a587624e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:01.598085 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-80637cea-5342-4f00-8d6b-55f2a587624e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:01.598508 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-80637cea-5342-4f00-8d6b-55f2a587624e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:01.688069 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-80637cea-5342-4f00-8d6b-55f2a587624e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.102473 Dec 15 16:28:01.688679 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 444/874] 10.222.0.60 () {60 vars in 1315 bytes} [Wed Dec 15 16:28:01 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:28:02.711175 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-a841eb7a-a640-4962-ab01-41078f95962c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:28:02.712173 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-a841eb7a-a640-4962-ab01-41078f95962c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:02.719030 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a841eb7a-a640-4962-ab01-41078f95962c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:02.719485 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a841eb7a-a640-4962-ab01-41078f95962c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:02.720521 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a841eb7a-a640-4962-ab01-41078f95962c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:02.720977 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a841eb7a-a640-4962-ab01-41078f95962c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:02.786175 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-a841eb7a-a640-4962-ab01-41078f95962c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action" status: 200 len: 14 microversion: 2.20 time: 0.078448 Dec 15 16:28:02.789772 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 431/875] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:28:02 2021] POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:02.841394 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-a7d17d4f-7139-475e-a282-498e88fe67f6 req-26b10129-7c86-4be8-93f0-49a63c3ba1af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfff70d8-7b03-417e-886b-1929e47645d5", "tag": "2e6e772a-f992-461a-881b-dffbf851deca"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:28:02.842952 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:28:02.842952 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:28:02.850051 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-a7d17d4f-7139-475e-a282-498e88fe67f6 req-26b10129-7c86-4be8-93f0-49a63c3ba1af service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:02.850577 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-a7d17d4f-7139-475e-a282-498e88fe67f6 req-26b10129-7c86-4be8-93f0-49a63c3ba1af service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:02.862266 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-a7d17d4f-7139-475e-a282-498e88fe67f6 req-26b10129-7c86-4be8-93f0-49a63c3ba1af service nova] Creating event network-changed:2e6e772a-f992-461a-881b-dffbf851deca for instance bfff70d8-7b03-417e-886b-1929e47645d5 on hv-cinder-81268 Dec 15 16:28:02.867205 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-a7d17d4f-7139-475e-a282-498e88fe67f6 req-26b10129-7c86-4be8-93f0-49a63c3ba1af service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156892 Dec 15 16:28:02.868090 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 445/876] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:28:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:28:03.799063 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-81993ccc-a75e-4589-8ed1-8fe077fdeed2 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:28:03.800534 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-81993ccc-a75e-4589-8ed1-8fe077fdeed2 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:03.807592 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-81993ccc-a75e-4589-8ed1-8fe077fdeed2 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:03.808058 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-81993ccc-a75e-4589-8ed1-8fe077fdeed2 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:03.808839 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-81993ccc-a75e-4589-8ed1-8fe077fdeed2 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:03.809275 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-81993ccc-a75e-4589-8ed1-8fe077fdeed2 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:03.870097 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-81993ccc-a75e-4589-8ed1-8fe077fdeed2 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action" status: 200 len: 14 microversion: 2.20 time: 0.075632 Dec 15 16:28:03.870748 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 432/877] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:28:03 2021] POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:04.882440 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c354095f-8b8b-4d5e-b7c5-a48a7f483d51 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:28:04.883492 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c354095f-8b8b-4d5e-b7c5-a48a7f483d51 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:04.890012 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c354095f-8b8b-4d5e-b7c5-a48a7f483d51 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:04.890494 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c354095f-8b8b-4d5e-b7c5-a48a7f483d51 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:04.891285 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c354095f-8b8b-4d5e-b7c5-a48a7f483d51 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:04.891753 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c354095f-8b8b-4d5e-b7c5-a48a7f483d51 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:04.951092 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c354095f-8b8b-4d5e-b7c5-a48a7f483d51 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action" status: 200 len: 14 microversion: 2.20 time: 0.073143 Dec 15 16:28:04.951834 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 446/878] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:28:04 2021] POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:05.965750 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-df0b9a6f-712f-40eb-8d5d-334f469f5d65 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:28:05.966731 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-df0b9a6f-712f-40eb-8d5d-334f469f5d65 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:05.974308 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-df0b9a6f-712f-40eb-8d5d-334f469f5d65 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:05.974696 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-df0b9a6f-712f-40eb-8d5d-334f469f5d65 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:05.975548 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-df0b9a6f-712f-40eb-8d5d-334f469f5d65 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:05.975976 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-df0b9a6f-712f-40eb-8d5d-334f469f5d65 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:06.035668 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-df0b9a6f-712f-40eb-8d5d-334f469f5d65 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action" status: 200 len: 14 microversion: 2.20 time: 0.073961 Dec 15 16:28:06.036331 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 433/879] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:28:05 2021] POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:07.047000 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b48cfa4c-27de-45c8-950c-7a7420af62e1 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:28:07.048043 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b48cfa4c-27de-45c8-950c-7a7420af62e1 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:07.055474 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b48cfa4c-27de-45c8-950c-7a7420af62e1 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:07.055948 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b48cfa4c-27de-45c8-950c-7a7420af62e1 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:07.056793 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b48cfa4c-27de-45c8-950c-7a7420af62e1 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:07.057224 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b48cfa4c-27de-45c8-950c-7a7420af62e1 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:07.116066 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b48cfa4c-27de-45c8-950c-7a7420af62e1 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action" status: 200 len: 14 microversion: 2.20 time: 0.072950 Dec 15 16:28:07.116742 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 447/880] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:28:07 2021] POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:07.298464 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-54173eb9-d22a-4d3b-8de1-ca7df2d773cf tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:28:07.299384 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-54173eb9-d22a-4d3b-8de1-ca7df2d773cf tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] [instance: 866ffde4-7bbe-4e59-8cdd-eba253d24fc7] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:07.306900 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-54173eb9-d22a-4d3b-8de1-ca7df2d773cf tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:07.307383 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-54173eb9-d22a-4d3b-8de1-ca7df2d773cf tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:07.308165 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-54173eb9-d22a-4d3b-8de1-ca7df2d773cf tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:07.308601 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-54173eb9-d22a-4d3b-8de1-ca7df2d773cf tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:07.366485 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-54173eb9-d22a-4d3b-8de1-ca7df2d773cf tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] 10.222.0.60 "POST /compute/v2.1/servers/866ffde4-7bbe-4e59-8cdd-eba253d24fc7/action" status: 200 len: 14 microversion: 2.1 time: 0.072109 Dec 15 16:28:07.367113 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 434/881] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:28:07 2021] POST /compute/v2.1/servers/866ffde4-7bbe-4e59-8cdd-eba253d24fc7/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:28:08.127967 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-115a3f4d-e151-4564-b6ed-66a0f00fd402 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:28:08.129064 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-115a3f4d-e151-4564-b6ed-66a0f00fd402 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:08.136465 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-115a3f4d-e151-4564-b6ed-66a0f00fd402 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:08.137220 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-115a3f4d-e151-4564-b6ed-66a0f00fd402 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:08.138206 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-115a3f4d-e151-4564-b6ed-66a0f00fd402 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:08.138806 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-115a3f4d-e151-4564-b6ed-66a0f00fd402 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:08.201540 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-115a3f4d-e151-4564-b6ed-66a0f00fd402 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action" status: 200 len: 14 microversion: 2.20 time: 0.076937 Dec 15 16:28:08.202748 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 448/882] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:28:08 2021] POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:08.322324 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-db7121e5-8f66-456b-8625-c33406cc7872 req-5b95690f-4c7e-4cea-aa1f-0a762f3797c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "866ffde4-7bbe-4e59-8cdd-eba253d24fc7", "tag": "16ce5e62-cdd5-406c-956b-1916ae817f6a"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:28:08.324941 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:28:08.324941 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:28:08.327123 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-8046e357-e558-46ca-a646-1354dedc7dd9 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:08.327761 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-8046e357-e558-46ca-a646-1354dedc7dd9 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] [instance: 866ffde4-7bbe-4e59-8cdd-eba253d24fc7] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:08.334258 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-db7121e5-8f66-456b-8625-c33406cc7872 req-5b95690f-4c7e-4cea-aa1f-0a762f3797c3 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:08.334679 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8046e357-e558-46ca-a646-1354dedc7dd9 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:08.335130 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-db7121e5-8f66-456b-8625-c33406cc7872 req-5b95690f-4c7e-4cea-aa1f-0a762f3797c3 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:08.335259 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8046e357-e558-46ca-a646-1354dedc7dd9 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:08.335990 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8046e357-e558-46ca-a646-1354dedc7dd9 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:08.336427 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8046e357-e558-46ca-a646-1354dedc7dd9 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:08.350517 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-db7121e5-8f66-456b-8625-c33406cc7872 req-5b95690f-4c7e-4cea-aa1f-0a762f3797c3 service nova] Creating event network-changed:16ce5e62-cdd5-406c-956b-1916ae817f6a for instance 866ffde4-7bbe-4e59-8cdd-eba253d24fc7 on hv-cinder-81268 Dec 15 16:28:08.356111 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-db7121e5-8f66-456b-8625-c33406cc7872 req-5b95690f-4c7e-4cea-aa1f-0a762f3797c3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038557 Dec 15 16:28:08.357092 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 449/883] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:28:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:28:08.366263 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-8046e357-e558-46ca-a646-1354dedc7dd9 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] [instance: 866ffde4-7bbe-4e59-8cdd-eba253d24fc7] Going to try to terminate instance {{(pid=116085) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:28:08.463731 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-8046e357-e558-46ca-a646-1354dedc7dd9 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] 10.222.0.60 "DELETE /compute/v2.1/servers/866ffde4-7bbe-4e59-8cdd-eba253d24fc7" status: 204 len: 0 microversion: 2.1 time: 0.148125 Dec 15 16:28:08.465429 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 435/884] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Dec 15 16:28:08 2021] DELETE /compute/v2.1/servers/866ffde4-7bbe-4e59-8cdd-eba253d24fc7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:28:08.476499 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-242ede89-d18e-4942-8ab7-4a80382880fb tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:08.477261 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-242ede89-d18e-4942-8ab7-4a80382880fb tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] [instance: 866ffde4-7bbe-4e59-8cdd-eba253d24fc7] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:08.485749 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-242ede89-d18e-4942-8ab7-4a80382880fb tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:08.486221 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-242ede89-d18e-4942-8ab7-4a80382880fb tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:08.486997 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-242ede89-d18e-4942-8ab7-4a80382880fb tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:08.487452 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-242ede89-d18e-4942-8ab7-4a80382880fb tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:08.661163 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-242ede89-d18e-4942-8ab7-4a80382880fb tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c46c8a697d044c8ba9b2c0e46c70c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd32b6eee5e4a75b6dec0e216953bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:08.669579 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-242ede89-d18e-4942-8ab7-4a80382880fb tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] 10.222.0.60 "GET /compute/v2.1/servers/866ffde4-7bbe-4e59-8cdd-eba253d24fc7" status: 200 len: 1575 microversion: 2.1 time: 0.199017 Dec 15 16:28:08.670510 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 450/885] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:08 2021] GET /compute/v2.1/servers/866ffde4-7bbe-4e59-8cdd-eba253d24fc7 => generated 1575 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:09.214683 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-1f3acc65-b375-47cb-ace7-5cc8256547d4 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:28:09.215734 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-1f3acc65-b375-47cb-ace7-5cc8256547d4 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:09.223484 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1f3acc65-b375-47cb-ace7-5cc8256547d4 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:09.223943 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1f3acc65-b375-47cb-ace7-5cc8256547d4 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:09.224786 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1f3acc65-b375-47cb-ace7-5cc8256547d4 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:09.225230 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1f3acc65-b375-47cb-ace7-5cc8256547d4 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:09.288133 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-1f3acc65-b375-47cb-ace7-5cc8256547d4 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action" status: 200 len: 14 microversion: 2.20 time: 0.078671 Dec 15 16:28:09.288816 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 436/886] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:28:09 2021] POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:09.688530 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-9aaf8d96-d3c2-4482-baea-da9b05ea32b6 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:09.689121 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-9aaf8d96-d3c2-4482-baea-da9b05ea32b6 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] [instance: 866ffde4-7bbe-4e59-8cdd-eba253d24fc7] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:09.695803 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9aaf8d96-d3c2-4482-baea-da9b05ea32b6 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:09.696261 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9aaf8d96-d3c2-4482-baea-da9b05ea32b6 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:09.697131 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9aaf8d96-d3c2-4482-baea-da9b05ea32b6 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:09.697815 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9aaf8d96-d3c2-4482-baea-da9b05ea32b6 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:09.845541 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-9aaf8d96-d3c2-4482-baea-da9b05ea32b6 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c46c8a697d044c8ba9b2c0e46c70c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd32b6eee5e4a75b6dec0e216953bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:09.853887 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-9aaf8d96-d3c2-4482-baea-da9b05ea32b6 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] 10.222.0.60 "GET /compute/v2.1/servers/866ffde4-7bbe-4e59-8cdd-eba253d24fc7" status: 200 len: 1457 microversion: 2.1 time: 0.169230 Dec 15 16:28:09.854470 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 451/887] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:09 2021] GET /compute/v2.1/servers/866ffde4-7bbe-4e59-8cdd-eba253d24fc7 => generated 1457 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:10.101896 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-ab472e58-8ef3-4064-9b7f-d56ba2942bb0 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:10.102474 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-ab472e58-8ef3-4064-9b7f-d56ba2942bb0 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:10.114383 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ab472e58-8ef3-4064-9b7f-d56ba2942bb0 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:10.114802 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ab472e58-8ef3-4064-9b7f-d56ba2942bb0 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:10.115663 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ab472e58-8ef3-4064-9b7f-d56ba2942bb0 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:10.116093 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ab472e58-8ef3-4064-9b7f-d56ba2942bb0 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:10.148625 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-ab472e58-8ef3-4064-9b7f-d56ba2942bb0 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/os-volume_attachments/9cdb5905-03f0-4c8b-b049-e516264b8dae" status: 200 len: 194 microversion: 2.1 time: 0.050858 Dec 15 16:28:10.149213 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 437/888] 10.222.0.60 () {58 vars in 1412 bytes} [Wed Dec 15 16:28:10 2021] GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/os-volume_attachments/9cdb5905-03f0-4c8b-b049-e516264b8dae => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:28:10.160504 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-7b10c338-fee2-45c6-b5c4-ff83769ecb66 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:10.161002 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-7b10c338-fee2-45c6-b5c4-ff83769ecb66 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:10.168017 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7b10c338-fee2-45c6-b5c4-ff83769ecb66 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:10.168450 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7b10c338-fee2-45c6-b5c4-ff83769ecb66 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:10.169237 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7b10c338-fee2-45c6-b5c4-ff83769ecb66 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:10.169664 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7b10c338-fee2-45c6-b5c4-ff83769ecb66 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:10.247118 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.objects.instance [None req-7b10c338-fee2-45c6-b5c4-ff83769ecb66 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lazy-loading 'services' on Instance uuid aace7dfb-6043-406a-b7cf-4a633e026c82 {{(pid=116084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:28:10.299474 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-22b6b105-6691-4f85-90d9-a9972331888b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:28:10.300473 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-22b6b105-6691-4f85-90d9-a9972331888b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:10.307151 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-22b6b105-6691-4f85-90d9-a9972331888b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:10.307625 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-22b6b105-6691-4f85-90d9-a9972331888b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:10.308596 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-22b6b105-6691-4f85-90d9-a9972331888b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:10.309517 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-22b6b105-6691-4f85-90d9-a9972331888b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:10.332970 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-7b10c338-fee2-45c6-b5c4-ff83769ecb66 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "DELETE /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/os-volume_attachments/9cdb5905-03f0-4c8b-b049-e516264b8dae" status: 202 len: 0 microversion: 2.1 time: 0.177285 Dec 15 16:28:10.334230 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 452/889] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Dec 15 16:28:10 2021] DELETE /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/os-volume_attachments/9cdb5905-03f0-4c8b-b049-e516264b8dae => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:28:10.386002 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-22b6b105-6691-4f85-90d9-a9972331888b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action" status: 200 len: 14 microversion: 2.20 time: 0.090194 Dec 15 16:28:10.390540 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 438/890] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:28:10 2021] POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:10.509485 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-eb7d6bc1-16c9-451f-bb34-cfeddfd3edd0 req-f99dabfb-0d2a-4bca-a8f8-6cb03fcfbff0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "866ffde4-7bbe-4e59-8cdd-eba253d24fc7", "name": "network-vif-deleted", "tag": "16ce5e62-cdd5-406c-956b-1916ae817f6a"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:28:10.511147 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:28:10.511147 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:28:10.522864 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-eb7d6bc1-16c9-451f-bb34-cfeddfd3edd0 req-f99dabfb-0d2a-4bca-a8f8-6cb03fcfbff0 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:10.522864 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-eb7d6bc1-16c9-451f-bb34-cfeddfd3edd0 req-f99dabfb-0d2a-4bca-a8f8-6cb03fcfbff0 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:10.534278 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-eb7d6bc1-16c9-451f-bb34-cfeddfd3edd0 req-f99dabfb-0d2a-4bca-a8f8-6cb03fcfbff0 service nova] Creating event network-vif-deleted:16ce5e62-cdd5-406c-956b-1916ae817f6a for instance 866ffde4-7bbe-4e59-8cdd-eba253d24fc7 on hv-cinder-81268 Dec 15 16:28:10.540939 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-eb7d6bc1-16c9-451f-bb34-cfeddfd3edd0 req-f99dabfb-0d2a-4bca-a8f8-6cb03fcfbff0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035653 Dec 15 16:28:10.541535 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 453/891] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:28:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:28:10.873018 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-0f542dc2-bb79-4dc2-b043-2618c1ac2735 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:10.873814 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-0f542dc2-bb79-4dc2-b043-2618c1ac2735 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] [instance: 866ffde4-7bbe-4e59-8cdd-eba253d24fc7] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:10.881142 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0f542dc2-bb79-4dc2-b043-2618c1ac2735 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:10.881677 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0f542dc2-bb79-4dc2-b043-2618c1ac2735 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:10.882477 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0f542dc2-bb79-4dc2-b043-2618c1ac2735 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:10.882914 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0f542dc2-bb79-4dc2-b043-2618c1ac2735 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:10.919858 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0f542dc2-bb79-4dc2-b043-2618c1ac2735 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:10.920313 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0f542dc2-bb79-4dc2-b043-2618c1ac2735 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:10.920763 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.objects.instance [None req-0f542dc2-bb79-4dc2-b043-2618c1ac2735 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lazy-loading 'fault' on Instance uuid 866ffde4-7bbe-4e59-8cdd-eba253d24fc7 {{(pid=116085) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:28:10.966483 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-0f542dc2-bb79-4dc2-b043-2618c1ac2735 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c46c8a697d044c8ba9b2c0e46c70c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd32b6eee5e4a75b6dec0e216953bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:10.974661 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-0f542dc2-bb79-4dc2-b043-2618c1ac2735 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] 10.222.0.60 "GET /compute/v2.1/servers/866ffde4-7bbe-4e59-8cdd-eba253d24fc7" status: 200 len: 1230 microversion: 2.1 time: 0.106506 Dec 15 16:28:10.975240 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 439/892] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:10 2021] GET /compute/v2.1/servers/866ffde4-7bbe-4e59-8cdd-eba253d24fc7 => generated 1230 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:11.400900 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b2fbfed1-7ff5-4de4-af08-9a7acb47e826 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:28:11.402044 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b2fbfed1-7ff5-4de4-af08-9a7acb47e826 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:11.408442 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b2fbfed1-7ff5-4de4-af08-9a7acb47e826 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:11.408865 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b2fbfed1-7ff5-4de4-af08-9a7acb47e826 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:11.409711 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b2fbfed1-7ff5-4de4-af08-9a7acb47e826 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:11.410087 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b2fbfed1-7ff5-4de4-af08-9a7acb47e826 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:11.456559 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-05c0dd02-8363-4495-a1ad-43e0965e93b8 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:11.457139 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-05c0dd02-8363-4495-a1ad-43e0965e93b8 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:11.464350 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-05c0dd02-8363-4495-a1ad-43e0965e93b8 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:11.464914 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-05c0dd02-8363-4495-a1ad-43e0965e93b8 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:11.465823 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-05c0dd02-8363-4495-a1ad-43e0965e93b8 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:11.466265 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-05c0dd02-8363-4495-a1ad-43e0965e93b8 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:11.475925 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b2fbfed1-7ff5-4de4-af08-9a7acb47e826 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action" status: 200 len: 14 microversion: 2.20 time: 0.080319 Dec 15 16:28:11.477176 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 454/893] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:28:11 2021] POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:11.505061 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-05c0dd02-8363-4495-a1ad-43e0965e93b8 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/os-volume_attachments/132008e8-3757-4006-b666-41870a78409b" status: 200 len: 194 microversion: 2.1 time: 0.052294 Dec 15 16:28:11.505648 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 440/894] 10.222.0.60 () {58 vars in 1412 bytes} [Wed Dec 15 16:28:11 2021] GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/os-volume_attachments/132008e8-3757-4006-b666-41870a78409b => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:28:11.515916 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-9018ed8f-4b56-4c93-8b03-266e0e1d36e1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:11.516482 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-9018ed8f-4b56-4c93-8b03-266e0e1d36e1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:11.523925 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9018ed8f-4b56-4c93-8b03-266e0e1d36e1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:11.524365 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9018ed8f-4b56-4c93-8b03-266e0e1d36e1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:11.525547 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9018ed8f-4b56-4c93-8b03-266e0e1d36e1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:11.525971 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9018ed8f-4b56-4c93-8b03-266e0e1d36e1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:11.619862 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.objects.instance [None req-9018ed8f-4b56-4c93-8b03-266e0e1d36e1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lazy-loading 'services' on Instance uuid aace7dfb-6043-406a-b7cf-4a633e026c82 {{(pid=116084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:28:11.692432 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-9018ed8f-4b56-4c93-8b03-266e0e1d36e1 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "DELETE /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/os-volume_attachments/132008e8-3757-4006-b666-41870a78409b" status: 202 len: 0 microversion: 2.1 time: 0.180481 Dec 15 16:28:11.693030 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 455/895] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Dec 15 16:28:11 2021] DELETE /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/os-volume_attachments/132008e8-3757-4006-b666-41870a78409b => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:28:11.992911 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-bc785a92-8ad3-4d39-b767-71fdb2bf7044 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:11.993507 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-bc785a92-8ad3-4d39-b767-71fdb2bf7044 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] [instance: 866ffde4-7bbe-4e59-8cdd-eba253d24fc7] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:12.001244 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bc785a92-8ad3-4d39-b767-71fdb2bf7044 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:12.001688 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bc785a92-8ad3-4d39-b767-71fdb2bf7044 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:12.002495 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bc785a92-8ad3-4d39-b767-71fdb2bf7044 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:12.002938 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-bc785a92-8ad3-4d39-b767-71fdb2bf7044 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:12.017492 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.wsgi [None req-bc785a92-8ad3-4d39-b767-71fdb2bf7044 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] HTTP exception thrown: Instance 866ffde4-7bbe-4e59-8cdd-eba253d24fc7 could not be found. Dec 15 16:28:12.018121 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-bc785a92-8ad3-4d39-b767-71fdb2bf7044 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Returning 404 to user: Instance 866ffde4-7bbe-4e59-8cdd-eba253d24fc7 could not be found. {{(pid=116085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:28:12.018935 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-bc785a92-8ad3-4d39-b767-71fdb2bf7044 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] 10.222.0.60 "GET /compute/v2.1/servers/866ffde4-7bbe-4e59-8cdd-eba253d24fc7" status: 404 len: 111 microversion: 2.1 time: 0.030289 Dec 15 16:28:12.019516 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 441/896] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:11 2021] GET /compute/v2.1/servers/866ffde4-7bbe-4e59-8cdd-eba253d24fc7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:28:12.489094 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-58dbcb82-8d4c-4426-96fa-e64fa866fd7b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:28:12.490285 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-58dbcb82-8d4c-4426-96fa-e64fa866fd7b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:12.498140 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-58dbcb82-8d4c-4426-96fa-e64fa866fd7b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:12.498585 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-58dbcb82-8d4c-4426-96fa-e64fa866fd7b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:12.499418 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-58dbcb82-8d4c-4426-96fa-e64fa866fd7b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:12.499837 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-58dbcb82-8d4c-4426-96fa-e64fa866fd7b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:12.560479 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-58dbcb82-8d4c-4426-96fa-e64fa866fd7b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action" status: 200 len: 14 microversion: 2.20 time: 0.076224 Dec 15 16:28:12.561117 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 456/897] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:28:12 2021] POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:12.857821 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-472e7220-143b-4b40-a742-a54edfb83dfc tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:12.858993 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-472e7220-143b-4b40-a742-a54edfb83dfc tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:12.866191 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-472e7220-143b-4b40-a742-a54edfb83dfc tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:12.866642 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-472e7220-143b-4b40-a742-a54edfb83dfc tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:12.867462 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-472e7220-143b-4b40-a742-a54edfb83dfc tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:12.867907 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-472e7220-143b-4b40-a742-a54edfb83dfc tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:12.904584 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-472e7220-143b-4b40-a742-a54edfb83dfc tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050689 Dec 15 16:28:12.905637 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 442/898] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Dec 15 16:28:12 2021] GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:28:13.023107 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0352a791-805c-423c-afff-4f41166ce842 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:13.024114 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-0352a791-805c-423c-afff-4f41166ce842 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:13.031416 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0352a791-805c-423c-afff-4f41166ce842 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:13.031893 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0352a791-805c-423c-afff-4f41166ce842 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:13.032651 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0352a791-805c-423c-afff-4f41166ce842 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:13.033119 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0352a791-805c-423c-afff-4f41166ce842 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:13.064606 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0352a791-805c-423c-afff-4f41166ce842 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045721 Dec 15 16:28:13.065215 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 457/899] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Dec 15 16:28:13 2021] GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:28:13.125590 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-178f8173-7848-4a4b-a306-161b98cf7361 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:13.126087 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-178f8173-7848-4a4b-a306-161b98cf7361 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:13.132724 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-178f8173-7848-4a4b-a306-161b98cf7361 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:13.133161 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-178f8173-7848-4a4b-a306-161b98cf7361 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:13.133958 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-178f8173-7848-4a4b-a306-161b98cf7361 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:13.134371 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-178f8173-7848-4a4b-a306-161b98cf7361 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:13.163863 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-178f8173-7848-4a4b-a306-161b98cf7361 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Going to try to terminate instance {{(pid=116085) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:28:13.247672 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-178f8173-7848-4a4b-a306-161b98cf7361 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "DELETE /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82" status: 204 len: 0 microversion: 2.1 time: 0.128117 Dec 15 16:28:13.248564 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 443/900] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Dec 15 16:28:13 2021] DELETE /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:28:13.256940 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b82ea8b8-cbb2-4156-9622-09dec2339997 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:13.257552 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b82ea8b8-cbb2-4156-9622-09dec2339997 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:13.264202 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b82ea8b8-cbb2-4156-9622-09dec2339997 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:13.264661 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b82ea8b8-cbb2-4156-9622-09dec2339997 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:13.265458 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b82ea8b8-cbb2-4156-9622-09dec2339997 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:13.265899 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b82ea8b8-cbb2-4156-9622-09dec2339997 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:13.380850 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-60a6d769-f97a-45ee-8321-b328db24be45 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] Calling method '.version_select at 0x7f0b269d1820>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:13.401019 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-60a6d769-f97a-45ee-8321-b328db24be45 tempest-TestVolumeBootPattern-1987570883 tempest-TestVolumeBootPattern-1987570883-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1448152906" status: 202 len: 0 microversion: 2.1 time: 0.024201 Dec 15 16:28:13.402521 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 444/901] 10.222.0.60 () {58 vars in 1262 bytes} [Wed Dec 15 16:28:13 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1448152906 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:28:13.434278 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b82ea8b8-cbb2-4156-9622-09dec2339997 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:13.442101 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b82ea8b8-cbb2-4156-9622-09dec2339997 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82" status: 200 len: 1672 microversion: 2.1 time: 0.189091 Dec 15 16:28:13.442707 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 458/902] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:13 2021] GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82 => generated 1672 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:13.571833 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-c53f4ca8-426e-47d7-b09e-9849555abd14 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:28:13.572865 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-c53f4ca8-426e-47d7-b09e-9849555abd14 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:13.580225 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c53f4ca8-426e-47d7-b09e-9849555abd14 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:13.580720 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c53f4ca8-426e-47d7-b09e-9849555abd14 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:13.581491 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c53f4ca8-426e-47d7-b09e-9849555abd14 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:13.581923 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c53f4ca8-426e-47d7-b09e-9849555abd14 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:13.653031 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-c53f4ca8-426e-47d7-b09e-9849555abd14 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action" status: 200 len: 10893 microversion: 2.20 time: 0.084706 Dec 15 16:28:13.653565 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 445/903] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:28:13 2021] POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action => generated 10893 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:28:14.460070 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-92ce7852-65fc-42f5-af5d-ffc989b2d20f tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:14.460838 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-92ce7852-65fc-42f5-af5d-ffc989b2d20f tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:14.468574 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-92ce7852-65fc-42f5-af5d-ffc989b2d20f tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:14.469026 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-92ce7852-65fc-42f5-af5d-ffc989b2d20f tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:14.469838 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-92ce7852-65fc-42f5-af5d-ffc989b2d20f tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:14.470315 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-92ce7852-65fc-42f5-af5d-ffc989b2d20f tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:14.618139 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-92ce7852-65fc-42f5-af5d-ffc989b2d20f tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:14.625986 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-92ce7852-65fc-42f5-af5d-ffc989b2d20f tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82" status: 200 len: 1672 microversion: 2.1 time: 0.169602 Dec 15 16:28:14.626568 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 459/904] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:14 2021] GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82 => generated 1672 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 15 16:28:14.665510 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-b310fd5f-8074-466e-9884-5bf73bc1256c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:28:14.666516 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-b310fd5f-8074-466e-9884-5bf73bc1256c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:14.675029 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b310fd5f-8074-466e-9884-5bf73bc1256c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:14.675533 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b310fd5f-8074-466e-9884-5bf73bc1256c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:14.676350 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b310fd5f-8074-466e-9884-5bf73bc1256c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:14.677297 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b310fd5f-8074-466e-9884-5bf73bc1256c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:14.759399 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-b310fd5f-8074-466e-9884-5bf73bc1256c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action" status: 200 len: 16319 microversion: 2.20 time: 0.098236 Dec 15 16:28:14.760070 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 446/905] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:28:14 2021] POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action => generated 16319 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:28:15.648052 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-7ee7013e-f989-4081-9725-159010106d95 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:15.649157 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-7ee7013e-f989-4081-9725-159010106d95 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:15.656582 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7ee7013e-f989-4081-9725-159010106d95 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:15.657347 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7ee7013e-f989-4081-9725-159010106d95 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:15.658651 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7ee7013e-f989-4081-9725-159010106d95 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:15.659280 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7ee7013e-f989-4081-9725-159010106d95 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:15.773317 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-9faf34c6-1db7-42f1-8f64-acf3ddee5433 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:28:15.775192 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-9faf34c6-1db7-42f1-8f64-acf3ddee5433 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:15.783881 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9faf34c6-1db7-42f1-8f64-acf3ddee5433 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:15.784630 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9faf34c6-1db7-42f1-8f64-acf3ddee5433 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:15.785846 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9faf34c6-1db7-42f1-8f64-acf3ddee5433 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:15.786437 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9faf34c6-1db7-42f1-8f64-acf3ddee5433 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:15.868418 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-9faf34c6-1db7-42f1-8f64-acf3ddee5433 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action" status: 200 len: 18356 microversion: 2.20 time: 0.100075 Dec 15 16:28:15.869219 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 447/906] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:28:15 2021] POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action => generated 18356 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:28:15.924021 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-7ee7013e-f989-4081-9725-159010106d95 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99b3403e60df4fbd9a5fdffe01a5efb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28737128a7574d248ba7e4e536171af2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:15.933259 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-7ee7013e-f989-4081-9725-159010106d95 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82" status: 200 len: 1672 microversion: 2.1 time: 0.293586 Dec 15 16:28:15.934663 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 460/907] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:15 2021] GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82 => generated 1672 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:16.327094 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-74c478b4-2508-4b89-b837-cb5acc31255f req-9add2887-9976-4680-b0c2-7cad85136f7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aace7dfb-6043-406a-b7cf-4a633e026c82", "name": "network-vif-deleted", "tag": "3ec4fed8-77d3-444b-b5eb-09f908b0f166"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:28:16.328667 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:28:16.328667 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Dec 15 16:28:16.369912 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-74c478b4-2508-4b89-b837-cb5acc31255f req-9add2887-9976-4680-b0c2-7cad85136f7c service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:16.371158 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-74c478b4-2508-4b89-b837-cb5acc31255f req-9add2887-9976-4680-b0c2-7cad85136f7c service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:16.415943 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-74c478b4-2508-4b89-b837-cb5acc31255f req-9add2887-9976-4680-b0c2-7cad85136f7c service nova] Creating event network-vif-deleted:3ec4fed8-77d3-444b-b5eb-09f908b0f166 for instance aace7dfb-6043-406a-b7cf-4a633e026c82 on hv-cinder-81268 Dec 15 16:28:16.427055 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-74c478b4-2508-4b89-b837-cb5acc31255f req-9add2887-9976-4680-b0c2-7cad85136f7c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104038 Dec 15 16:28:16.434110 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 448/908] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:28:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:28:16.880435 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-8dd4d00d-b325-4506-a1b9-1e322c4783c2 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:28:16.881508 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-8dd4d00d-b325-4506-a1b9-1e322c4783c2 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:16.889085 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8dd4d00d-b325-4506-a1b9-1e322c4783c2 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:16.889858 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8dd4d00d-b325-4506-a1b9-1e322c4783c2 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:16.890965 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8dd4d00d-b325-4506-a1b9-1e322c4783c2 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:16.891420 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8dd4d00d-b325-4506-a1b9-1e322c4783c2 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:16.950954 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-94de0a28-89bd-4c1c-8c49-3cd9dc09e24a tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:16.951647 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-94de0a28-89bd-4c1c-8c49-3cd9dc09e24a tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:16.958614 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-94de0a28-89bd-4c1c-8c49-3cd9dc09e24a tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:16.959195 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-94de0a28-89bd-4c1c-8c49-3cd9dc09e24a tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:16.960089 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-94de0a28-89bd-4c1c-8c49-3cd9dc09e24a tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:16.960576 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-94de0a28-89bd-4c1c-8c49-3cd9dc09e24a tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:16.972990 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-8dd4d00d-b325-4506-a1b9-1e322c4783c2 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action" status: 200 len: 20997 microversion: 2.20 time: 0.096121 Dec 15 16:28:16.975589 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.wsgi [None req-94de0a28-89bd-4c1c-8c49-3cd9dc09e24a tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] HTTP exception thrown: Instance aace7dfb-6043-406a-b7cf-4a633e026c82 could not be found. Dec 15 16:28:16.976546 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-94de0a28-89bd-4c1c-8c49-3cd9dc09e24a tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Returning 404 to user: Instance aace7dfb-6043-406a-b7cf-4a633e026c82 could not be found. {{(pid=116085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:28:16.977616 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-94de0a28-89bd-4c1c-8c49-3cd9dc09e24a tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82" status: 404 len: 111 microversion: 2.1 time: 0.030958 Dec 15 16:28:16.977741 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 461/909] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:28:16 2021] POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action => generated 20997 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:28:16.978441 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 449/910] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:16 2021] GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:28:16.988910 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-693f3777-43e8-4819-baba-8699c150f40e tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '.version_select at 0x7f0b26999a60>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:17.013122 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-693f3777-43e8-4819-baba-8699c150f40e tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-654256954" status: 202 len: 0 microversion: 2.1 time: 0.028778 Dec 15 16:28:17.013753 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 462/911] 10.222.0.60 () {58 vars in 1217 bytes} [Wed Dec 15 16:28:16 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-654256954 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:28:17.984403 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-e698fda9-3f9d-4ed8-86c0-cc230d8a4830 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:28:17.985553 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-e698fda9-3f9d-4ed8-86c0-cc230d8a4830 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:17.993085 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e698fda9-3f9d-4ed8-86c0-cc230d8a4830 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:17.993531 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e698fda9-3f9d-4ed8-86c0-cc230d8a4830 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:17.994450 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e698fda9-3f9d-4ed8-86c0-cc230d8a4830 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:17.995155 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e698fda9-3f9d-4ed8-86c0-cc230d8a4830 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:18.070476 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-e698fda9-3f9d-4ed8-86c0-cc230d8a4830 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action" status: 200 len: 22949 microversion: 2.20 time: 0.089681 Dec 15 16:28:18.071402 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 450/912] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:28:17 2021] POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action => generated 22949 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:28:19.082658 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-43733b82-e3f3-4881-b5f8-6b4814996714 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:28:19.084279 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-43733b82-e3f3-4881-b5f8-6b4814996714 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:19.092698 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-43733b82-e3f3-4881-b5f8-6b4814996714 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:19.093060 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-43733b82-e3f3-4881-b5f8-6b4814996714 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:19.094980 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-43733b82-e3f3-4881-b5f8-6b4814996714 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:19.095633 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-43733b82-e3f3-4881-b5f8-6b4814996714 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:19.179764 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-43733b82-e3f3-4881-b5f8-6b4814996714 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action" status: 200 len: 24332 microversion: 2.20 time: 0.101460 Dec 15 16:28:19.180754 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 463/913] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:28:19 2021] POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action => generated 24332 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:28:20.196009 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-f75bd2db-0c23-49c9-a845-68dfe7f55bf7 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:28:20.197103 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-f75bd2db-0c23-49c9-a845-68dfe7f55bf7 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:20.204625 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f75bd2db-0c23-49c9-a845-68dfe7f55bf7 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:20.205072 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f75bd2db-0c23-49c9-a845-68dfe7f55bf7 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:20.205867 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f75bd2db-0c23-49c9-a845-68dfe7f55bf7 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:20.206289 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f75bd2db-0c23-49c9-a845-68dfe7f55bf7 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:20.245876 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-2089e3de-08c8-46ae-a830-5c78cf386415 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:20.246864 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-2089e3de-08c8-46ae-a830-5c78cf386415 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:20.254160 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2089e3de-08c8-46ae-a830-5c78cf386415 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:20.254682 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2089e3de-08c8-46ae-a830-5c78cf386415 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:20.255625 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2089e3de-08c8-46ae-a830-5c78cf386415 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:20.256067 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2089e3de-08c8-46ae-a830-5c78cf386415 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:20.273193 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-2089e3de-08c8-46ae-a830-5c78cf386415 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] HTTP exception thrown: Instance aace7dfb-6043-406a-b7cf-4a633e026c82 could not be found. Dec 15 16:28:20.273820 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-2089e3de-08c8-46ae-a830-5c78cf386415 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Returning 404 to user: Instance aace7dfb-6043-406a-b7cf-4a633e026c82 could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:28:20.274668 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-2089e3de-08c8-46ae-a830-5c78cf386415 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "DELETE /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82" status: 404 len: 111 microversion: 2.1 time: 0.033389 Dec 15 16:28:20.275232 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 464/914] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Dec 15 16:28:20 2021] DELETE /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:28:20.285311 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-66b670b3-3c58-4d5b-860c-c5243624a70b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:20.285557 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-f75bd2db-0c23-49c9-a845-68dfe7f55bf7 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action" status: 200 len: 26004 microversion: 2.20 time: 0.094050 Dec 15 16:28:20.286146 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 451/915] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:28:20 2021] POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action => generated 26004 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:28:20.286674 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-66b670b3-3c58-4d5b-860c-c5243624a70b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: aace7dfb-6043-406a-b7cf-4a633e026c82] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:20.300410 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-66b670b3-3c58-4d5b-860c-c5243624a70b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:20.300845 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-66b670b3-3c58-4d5b-860c-c5243624a70b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:20.301694 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-66b670b3-3c58-4d5b-860c-c5243624a70b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:20.302106 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-66b670b3-3c58-4d5b-860c-c5243624a70b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:20.319949 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-66b670b3-3c58-4d5b-860c-c5243624a70b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] HTTP exception thrown: Instance aace7dfb-6043-406a-b7cf-4a633e026c82 could not be found. Dec 15 16:28:20.319949 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-66b670b3-3c58-4d5b-860c-c5243624a70b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Returning 404 to user: Instance aace7dfb-6043-406a-b7cf-4a633e026c82 could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:28:20.319949 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-66b670b3-3c58-4d5b-860c-c5243624a70b tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82" status: 404 len: 111 microversion: 2.1 time: 0.038624 Dec 15 16:28:20.319949 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 465/916] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:20 2021] GET /compute/v2.1/servers/aace7dfb-6043-406a-b7cf-4a633e026c82 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 15 16:28:21.298885 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-e3c34f67-3c6f-4201-a9e7-00964ffe595b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:28:21.299914 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-e3c34f67-3c6f-4201-a9e7-00964ffe595b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:21.307922 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e3c34f67-3c6f-4201-a9e7-00964ffe595b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:21.308377 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e3c34f67-3c6f-4201-a9e7-00964ffe595b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:21.309187 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e3c34f67-3c6f-4201-a9e7-00964ffe595b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:21.309621 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e3c34f67-3c6f-4201-a9e7-00964ffe595b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:21.392199 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-e3c34f67-3c6f-4201-a9e7-00964ffe595b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action" status: 200 len: 27248 microversion: 2.20 time: 0.097309 Dec 15 16:28:21.393379 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 452/917] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:28:21 2021] POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action => generated 27248 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:28:21.496379 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-de4d1895-8c32-4fa6-8496-b3ca2b17e4c3 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:21.496981 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-de4d1895-8c32-4fa6-8496-b3ca2b17e4c3 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:21.504047 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-de4d1895-8c32-4fa6-8496-b3ca2b17e4c3 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:21.504433 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-de4d1895-8c32-4fa6-8496-b3ca2b17e4c3 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:21.505233 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-de4d1895-8c32-4fa6-8496-b3ca2b17e4c3 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:21.505666 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-de4d1895-8c32-4fa6-8496-b3ca2b17e4c3 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:21.520808 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-de4d1895-8c32-4fa6-8496-b3ca2b17e4c3 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] HTTP exception thrown: Instance f48359cf-b1e0-4786-885d-3aa339bbf38a could not be found. Dec 15 16:28:21.521427 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-de4d1895-8c32-4fa6-8496-b3ca2b17e4c3 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Returning 404 to user: Instance f48359cf-b1e0-4786-885d-3aa339bbf38a could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:28:21.522350 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-de4d1895-8c32-4fa6-8496-b3ca2b17e4c3 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 404 len: 111 microversion: 2.1 time: 0.030910 Dec 15 16:28:21.522932 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 466/918] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Dec 15 16:28:21 2021] DELETE /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:28:21.532097 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-681315fd-07c7-4695-b6c7-095ad149aae6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:21.532873 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-681315fd-07c7-4695-b6c7-095ad149aae6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] [instance: f48359cf-b1e0-4786-885d-3aa339bbf38a] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:21.540197 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-681315fd-07c7-4695-b6c7-095ad149aae6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:21.540653 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-681315fd-07c7-4695-b6c7-095ad149aae6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:21.541422 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-681315fd-07c7-4695-b6c7-095ad149aae6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:21.542175 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-681315fd-07c7-4695-b6c7-095ad149aae6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:21.556900 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.wsgi [None req-681315fd-07c7-4695-b6c7-095ad149aae6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] HTTP exception thrown: Instance f48359cf-b1e0-4786-885d-3aa339bbf38a could not be found. Dec 15 16:28:21.557495 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-681315fd-07c7-4695-b6c7-095ad149aae6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] Returning 404 to user: Instance f48359cf-b1e0-4786-885d-3aa339bbf38a could not be found. {{(pid=116085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:28:21.558678 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-681315fd-07c7-4695-b6c7-095ad149aae6 tempest-AttachVolumeTestJSON-1298844687 tempest-AttachVolumeTestJSON-1298844687-project] 10.222.0.60 "GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a" status: 404 len: 111 microversion: 2.1 time: 0.031286 Dec 15 16:28:21.559458 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 453/919] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:21 2021] GET /compute/v2.1/servers/f48359cf-b1e0-4786-885d-3aa339bbf38a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:28:22.405912 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e94e67dd-bc91-47f4-bcc0-57ae85aa44a8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:28:22.406913 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e94e67dd-bc91-47f4-bcc0-57ae85aa44a8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:22.413973 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e94e67dd-bc91-47f4-bcc0-57ae85aa44a8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:22.414427 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e94e67dd-bc91-47f4-bcc0-57ae85aa44a8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:22.415227 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e94e67dd-bc91-47f4-bcc0-57ae85aa44a8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:22.415720 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e94e67dd-bc91-47f4-bcc0-57ae85aa44a8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:22.496910 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e94e67dd-bc91-47f4-bcc0-57ae85aa44a8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action" status: 200 len: 27932 microversion: 2.20 time: 0.094853 Dec 15 16:28:22.497645 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 467/920] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:28:22 2021] POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action => generated 27932 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:28:23.509165 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-8d360ba9-8d3b-4e02-8cf9-7c252dfda7de tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:28:23.510195 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-8d360ba9-8d3b-4e02-8cf9-7c252dfda7de tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:23.517216 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8d360ba9-8d3b-4e02-8cf9-7c252dfda7de tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:23.517682 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8d360ba9-8d3b-4e02-8cf9-7c252dfda7de tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:23.518462 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8d360ba9-8d3b-4e02-8cf9-7c252dfda7de tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:23.518880 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8d360ba9-8d3b-4e02-8cf9-7c252dfda7de tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:23.598557 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-8d360ba9-8d3b-4e02-8cf9-7c252dfda7de tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action" status: 200 len: 28188 microversion: 2.20 time: 0.092937 Dec 15 16:28:23.599332 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 454/921] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:28:23 2021] POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action => generated 28188 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:28:24.611583 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-06149e47-dc7f-491d-a236-2e2e56cffe06 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:28:24.613323 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-06149e47-dc7f-491d-a236-2e2e56cffe06 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:24.624260 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-06149e47-dc7f-491d-a236-2e2e56cffe06 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:24.624710 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-06149e47-dc7f-491d-a236-2e2e56cffe06 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:24.625506 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-06149e47-dc7f-491d-a236-2e2e56cffe06 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:24.625934 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-06149e47-dc7f-491d-a236-2e2e56cffe06 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:24.691474 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-06149e47-dc7f-491d-a236-2e2e56cffe06 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action" status: 200 len: 28188 microversion: 2.20 time: 0.084020 Dec 15 16:28:24.692122 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 468/922] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:28:24 2021] POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action => generated 28188 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:28:25.705923 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-17c82d96-5b8c-430e-9d82-35acb7a43261 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:28:25.706933 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-17c82d96-5b8c-430e-9d82-35acb7a43261 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:25.715303 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-17c82d96-5b8c-430e-9d82-35acb7a43261 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:25.715792 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-17c82d96-5b8c-430e-9d82-35acb7a43261 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:25.716573 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-17c82d96-5b8c-430e-9d82-35acb7a43261 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:25.717009 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-17c82d96-5b8c-430e-9d82-35acb7a43261 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:25.799034 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-17c82d96-5b8c-430e-9d82-35acb7a43261 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action" status: 200 len: 28479 microversion: 2.20 time: 0.097583 Dec 15 16:28:25.799721 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 455/923] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:28:25 2021] POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action => generated 28479 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:28:26.811520 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-988b7c98-20e3-432e-b2dc-72331475355b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:28:26.812518 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-988b7c98-20e3-432e-b2dc-72331475355b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:26.819702 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-988b7c98-20e3-432e-b2dc-72331475355b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:26.820169 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-988b7c98-20e3-432e-b2dc-72331475355b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:26.820940 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-988b7c98-20e3-432e-b2dc-72331475355b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:26.821364 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-988b7c98-20e3-432e-b2dc-72331475355b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:26.898583 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-988b7c98-20e3-432e-b2dc-72331475355b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action" status: 200 len: 28647 microversion: 2.20 time: 0.090910 Dec 15 16:28:26.899570 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 469/924] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:28:26 2021] POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action => generated 28647 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:28:27.912181 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-74e8b888-2548-4b90-991f-a827f046210c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:28:27.913486 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-74e8b888-2548-4b90-991f-a827f046210c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:27.921881 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-74e8b888-2548-4b90-991f-a827f046210c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:27.922284 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-74e8b888-2548-4b90-991f-a827f046210c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:27.923596 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-74e8b888-2548-4b90-991f-a827f046210c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:27.924249 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-74e8b888-2548-4b90-991f-a827f046210c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:27.990527 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-74e8b888-2548-4b90-991f-a827f046210c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action" status: 200 len: 28647 microversion: 2.20 time: 0.082308 Dec 15 16:28:27.991245 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 456/925] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:28:27 2021] POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action => generated 28647 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:28:29.002297 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-63821ca9-f546-4292-8386-ff494eea9b13 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:28:29.003537 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-63821ca9-f546-4292-8386-ff494eea9b13 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:29.010723 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-63821ca9-f546-4292-8386-ff494eea9b13 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:29.011168 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-63821ca9-f546-4292-8386-ff494eea9b13 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:29.012277 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-63821ca9-f546-4292-8386-ff494eea9b13 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:29.012709 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-63821ca9-f546-4292-8386-ff494eea9b13 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:29.077461 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-63821ca9-f546-4292-8386-ff494eea9b13 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action" status: 200 len: 28647 microversion: 2.20 time: 0.079263 Dec 15 16:28:29.078663 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 470/926] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:28:28 2021] POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action => generated 28647 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:28:30.090848 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-82200767-5e48-45fb-86c1-f05d2ace79f1 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:28:30.092008 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-82200767-5e48-45fb-86c1-f05d2ace79f1 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:30.099737 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-82200767-5e48-45fb-86c1-f05d2ace79f1 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:30.100189 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-82200767-5e48-45fb-86c1-f05d2ace79f1 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:30.100988 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-82200767-5e48-45fb-86c1-f05d2ace79f1 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:30.101426 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-82200767-5e48-45fb-86c1-f05d2ace79f1 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:30.182475 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-82200767-5e48-45fb-86c1-f05d2ace79f1 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action" status: 200 len: 30587 microversion: 2.20 time: 0.096199 Dec 15 16:28:30.183146 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 457/927] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:28:30 2021] POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action => generated 30587 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:28:31.196323 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c8193286-3a9f-4466-b385-921ee8cb62a9 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:28:31.197323 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c8193286-3a9f-4466-b385-921ee8cb62a9 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:31.218639 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c8193286-3a9f-4466-b385-921ee8cb62a9 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:31.218639 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c8193286-3a9f-4466-b385-921ee8cb62a9 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:31.218639 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c8193286-3a9f-4466-b385-921ee8cb62a9 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:31.218639 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c8193286-3a9f-4466-b385-921ee8cb62a9 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:31.291563 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c8193286-3a9f-4466-b385-921ee8cb62a9 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action" status: 200 len: 32644 microversion: 2.20 time: 0.099134 Dec 15 16:28:31.292331 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 471/928] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:28:31 2021] POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action => generated 32644 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:28:32.303752 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-34a64064-3f47-4ba7-a510-f3a2f9c15135 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:28:32.304801 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-34a64064-3f47-4ba7-a510-f3a2f9c15135 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:32.312422 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-34a64064-3f47-4ba7-a510-f3a2f9c15135 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:32.312872 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-34a64064-3f47-4ba7-a510-f3a2f9c15135 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:32.313757 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-34a64064-3f47-4ba7-a510-f3a2f9c15135 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:32.314198 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-34a64064-3f47-4ba7-a510-f3a2f9c15135 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:32.390133 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-34a64064-3f47-4ba7-a510-f3a2f9c15135 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action" status: 200 len: 33705 microversion: 2.20 time: 0.090252 Dec 15 16:28:32.390693 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 458/929] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:28:32 2021] POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action => generated 33705 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:28:33.405466 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e6984ccc-c41f-4b5d-ad6c-6742a0743a90 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:28:33.406506 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e6984ccc-c41f-4b5d-ad6c-6742a0743a90 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:33.416587 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e6984ccc-c41f-4b5d-ad6c-6742a0743a90 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:33.417060 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e6984ccc-c41f-4b5d-ad6c-6742a0743a90 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:33.417840 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e6984ccc-c41f-4b5d-ad6c-6742a0743a90 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:33.418281 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e6984ccc-c41f-4b5d-ad6c-6742a0743a90 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:34.982284 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-dbf74c0a-51b1-410f-8113-38a92bc5e43a tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:34.982876 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-dbf74c0a-51b1-410f-8113-38a92bc5e43a tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:34.990253 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-dbf74c0a-51b1-410f-8113-38a92bc5e43a tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:34.990718 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-dbf74c0a-51b1-410f-8113-38a92bc5e43a tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:34.991511 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-dbf74c0a-51b1-410f-8113-38a92bc5e43a tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:34.991944 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-dbf74c0a-51b1-410f-8113-38a92bc5e43a tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:35.018709 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-dbf74c0a-51b1-410f-8113-38a92bc5e43a tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Going to try to terminate instance {{(pid=116085) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:28:35.108857 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-dbf74c0a-51b1-410f-8113-38a92bc5e43a tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "DELETE /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d" status: 204 len: 0 microversion: 2.1 time: 0.131046 Dec 15 16:28:35.109634 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 459/930] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Dec 15 16:28:34 2021] DELETE /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 15 16:28:35.115194 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-591800e6-b895-461f-88aa-4f884ecc2e13 req-450e6e5a-1358-4e49-ba6b-f3fa52799407 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afd5ac96-daf3-4608-818c-190e076c2f6d", "tag": "7f96dd5b-86e2-412f-920f-6abc632fd890"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:28:35.116726 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:28:35.116726 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Dec 15 16:28:35.124274 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-591800e6-b895-461f-88aa-4f884ecc2e13 req-450e6e5a-1358-4e49-ba6b-f3fa52799407 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:35.124703 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-591800e6-b895-461f-88aa-4f884ecc2e13 req-450e6e5a-1358-4e49-ba6b-f3fa52799407 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:35.135975 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-591800e6-b895-461f-88aa-4f884ecc2e13 req-450e6e5a-1358-4e49-ba6b-f3fa52799407 service nova] Creating event network-changed:7f96dd5b-86e2-412f-920f-6abc632fd890 for instance afd5ac96-daf3-4608-818c-190e076c2f6d on hv-cinder-81268 Dec 15 16:28:35.141038 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-591800e6-b895-461f-88aa-4f884ecc2e13 req-450e6e5a-1358-4e49-ba6b-f3fa52799407 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030110 Dec 15 16:28:35.141633 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 460/931] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:28:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:28:35.146388 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-a44d3eb1-1fdd-42b0-99b1-15f7671a2167 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:35.147056 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-a44d3eb1-1fdd-42b0-99b1-15f7671a2167 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:35.153259 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a44d3eb1-1fdd-42b0-99b1-15f7671a2167 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:35.153696 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a44d3eb1-1fdd-42b0-99b1-15f7671a2167 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:35.154551 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a44d3eb1-1fdd-42b0-99b1-15f7671a2167 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:35.154975 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a44d3eb1-1fdd-42b0-99b1-15f7671a2167 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:35.291883 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-a44d3eb1-1fdd-42b0-99b1-15f7671a2167 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b554f95b7b4444ab70e9dabf8197de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fc732badb0488392694e6d6c67d5dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:35.299949 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-a44d3eb1-1fdd-42b0-99b1-15f7671a2167 tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d" status: 200 len: 1568 microversion: 2.1 time: 0.157202 Dec 15 16:28:35.300552 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 461/932] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:35 2021] GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:35.777833 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e6984ccc-c41f-4b5d-ad6c-6742a0743a90 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action" status: 200 len: 38028 microversion: 2.20 time: 2.376141 Dec 15 16:28:35.779215 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 472/933] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:28:33 2021] POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action => generated 38028 bytes in 2380 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:28:36.318043 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-c4d06af4-53df-429d-8eb9-024d4f2d458c tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:36.319757 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-c4d06af4-53df-429d-8eb9-024d4f2d458c tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:36.327730 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c4d06af4-53df-429d-8eb9-024d4f2d458c tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:36.328295 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c4d06af4-53df-429d-8eb9-024d4f2d458c tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:36.329407 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c4d06af4-53df-429d-8eb9-024d4f2d458c tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:36.329407 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c4d06af4-53df-429d-8eb9-024d4f2d458c tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:36.475151 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-c4d06af4-53df-429d-8eb9-024d4f2d458c tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b554f95b7b4444ab70e9dabf8197de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fc732badb0488392694e6d6c67d5dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:36.483530 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-c4d06af4-53df-429d-8eb9-024d4f2d458c tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d" status: 200 len: 1449 microversion: 2.1 time: 0.169248 Dec 15 16:28:36.484126 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 462/934] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:36 2021] GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d => generated 1449 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:36.793242 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-7f0335f1-5063-47c7-819d-d498d678bee8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:28:36.794310 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-7f0335f1-5063-47c7-819d-d498d678bee8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:36.802168 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7f0335f1-5063-47c7-819d-d498d678bee8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:36.802629 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7f0335f1-5063-47c7-819d-d498d678bee8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:36.803399 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7f0335f1-5063-47c7-819d-d498d678bee8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:36.803874 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7f0335f1-5063-47c7-819d-d498d678bee8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:36.878115 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-7f0335f1-5063-47c7-819d-d498d678bee8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action" status: 200 len: 38206 microversion: 2.20 time: 0.088434 Dec 15 16:28:36.879136 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 473/935] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:28:36 2021] POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action => generated 38206 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:28:37.500532 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-d59466ca-1ca2-44fe-b60a-13ddba09dc9d tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:37.501113 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-d59466ca-1ca2-44fe-b60a-13ddba09dc9d tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:37.507841 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d59466ca-1ca2-44fe-b60a-13ddba09dc9d tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:37.508283 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d59466ca-1ca2-44fe-b60a-13ddba09dc9d tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:37.509053 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d59466ca-1ca2-44fe-b60a-13ddba09dc9d tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:37.509479 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d59466ca-1ca2-44fe-b60a-13ddba09dc9d tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:37.653406 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-d59466ca-1ca2-44fe-b60a-13ddba09dc9d tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b554f95b7b4444ab70e9dabf8197de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fc732badb0488392694e6d6c67d5dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:37.661485 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-d59466ca-1ca2-44fe-b60a-13ddba09dc9d tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d" status: 200 len: 1449 microversion: 2.1 time: 0.164699 Dec 15 16:28:37.662744 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 463/936] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:37 2021] GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d => generated 1449 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:28:37.895039 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-5de1eaa8-f999-467e-bb2f-c19bb775f664 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:28:37.896185 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-5de1eaa8-f999-467e-bb2f-c19bb775f664 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:37.903604 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5de1eaa8-f999-467e-bb2f-c19bb775f664 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:37.904139 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5de1eaa8-f999-467e-bb2f-c19bb775f664 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:37.904948 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5de1eaa8-f999-467e-bb2f-c19bb775f664 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:37.905402 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-5de1eaa8-f999-467e-bb2f-c19bb775f664 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:37.935144 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-6912c23c-4d70-4cac-a123-cbe82efd1838 req-c00f80ad-014d-4c3b-857a-8f89df4d5213 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afd5ac96-daf3-4608-818c-190e076c2f6d", "name": "network-vif-deleted", "tag": "7f96dd5b-86e2-412f-920f-6abc632fd890"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:28:37.938452 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:28:37.938452 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Dec 15 16:28:37.946934 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-6912c23c-4d70-4cac-a123-cbe82efd1838 req-c00f80ad-014d-4c3b-857a-8f89df4d5213 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:37.947581 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-6912c23c-4d70-4cac-a123-cbe82efd1838 req-c00f80ad-014d-4c3b-857a-8f89df4d5213 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:37.961748 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-6912c23c-4d70-4cac-a123-cbe82efd1838 req-c00f80ad-014d-4c3b-857a-8f89df4d5213 service nova] Creating event network-vif-deleted:7f96dd5b-86e2-412f-920f-6abc632fd890 for instance afd5ac96-daf3-4608-818c-190e076c2f6d on hv-cinder-81268 Dec 15 16:28:37.967469 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-6912c23c-4d70-4cac-a123-cbe82efd1838 req-c00f80ad-014d-4c3b-857a-8f89df4d5213 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036705 Dec 15 16:28:37.968077 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 464/937] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:28:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:28:37.974346 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-5de1eaa8-f999-467e-bb2f-c19bb775f664 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action" status: 200 len: 38206 microversion: 2.20 time: 0.084151 Dec 15 16:28:37.975161 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 474/938] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:28:37 2021] POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action => generated 38206 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:28:38.680371 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-fda611dd-f8d5-4129-84f7-d0b405202d3d tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:38.681244 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-fda611dd-f8d5-4129-84f7-d0b405202d3d tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] [instance: afd5ac96-daf3-4608-818c-190e076c2f6d] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:38.689004 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fda611dd-f8d5-4129-84f7-d0b405202d3d tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:38.689477 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fda611dd-f8d5-4129-84f7-d0b405202d3d tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:38.690261 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fda611dd-f8d5-4129-84f7-d0b405202d3d tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:38.690687 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fda611dd-f8d5-4129-84f7-d0b405202d3d tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:38.706705 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.wsgi [None req-fda611dd-f8d5-4129-84f7-d0b405202d3d tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] HTTP exception thrown: Instance afd5ac96-daf3-4608-818c-190e076c2f6d could not be found. Dec 15 16:28:38.707300 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-fda611dd-f8d5-4129-84f7-d0b405202d3d tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Returning 404 to user: Instance afd5ac96-daf3-4608-818c-190e076c2f6d could not be found. {{(pid=116085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:28:38.708126 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-fda611dd-f8d5-4129-84f7-d0b405202d3d tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d" status: 404 len: 111 microversion: 2.1 time: 0.032186 Dec 15 16:28:38.708847 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 465/939] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:28:38 2021] GET /compute/v2.1/servers/afd5ac96-daf3-4608-818c-190e076c2f6d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:28:38.887715 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b01cf607-7ca0-41d4-b8a5-d12f54af9d5f tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] Calling method '.version_select at 0x7f0b2692c430>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:38.929784 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b01cf607-7ca0-41d4-b8a5-d12f54af9d5f tempest-TestShelveInstance-1481392955 tempest-TestShelveInstance-1481392955-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-663151410" status: 202 len: 0 microversion: 2.1 time: 0.046179 Dec 15 16:28:38.930508 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 475/940] 10.222.0.60 () {58 vars in 1250 bytes} [Wed Dec 15 16:28:38 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-663151410 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:28:38.986680 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-fcbcad07-24f3-4d64-9816-24af32838b77 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:28:38.987716 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-fcbcad07-24f3-4d64-9816-24af32838b77 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:38.995437 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fcbcad07-24f3-4d64-9816-24af32838b77 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:38.995888 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fcbcad07-24f3-4d64-9816-24af32838b77 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:38.996981 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fcbcad07-24f3-4d64-9816-24af32838b77 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:38.997406 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fcbcad07-24f3-4d64-9816-24af32838b77 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:39.065029 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-fcbcad07-24f3-4d64-9816-24af32838b77 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action" status: 200 len: 38206 microversion: 2.20 time: 0.082380 Dec 15 16:28:39.065825 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 466/941] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:28:38 2021] POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action => generated 38206 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:28:40.078668 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b834df12-f997-42f6-b95f-23e10c4fa93e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:28:40.080677 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b834df12-f997-42f6-b95f-23e10c4fa93e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:40.088382 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b834df12-f997-42f6-b95f-23e10c4fa93e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:40.089335 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b834df12-f997-42f6-b95f-23e10c4fa93e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:40.090972 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b834df12-f997-42f6-b95f-23e10c4fa93e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:40.092676 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b834df12-f997-42f6-b95f-23e10c4fa93e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:40.171948 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b834df12-f997-42f6-b95f-23e10c4fa93e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action" status: 200 len: 38349 microversion: 2.20 time: 0.097621 Dec 15 16:28:40.173433 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 476/942] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:28:40 2021] POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action => generated 38349 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:28:40.183712 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-e4b162b0-2804-451f-bcc7-9f275da84243 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:40.184298 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-e4b162b0-2804-451f-bcc7-9f275da84243 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:40.197911 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e4b162b0-2804-451f-bcc7-9f275da84243 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:40.198932 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e4b162b0-2804-451f-bcc7-9f275da84243 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:40.199984 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e4b162b0-2804-451f-bcc7-9f275da84243 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:40.200429 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-e4b162b0-2804-451f-bcc7-9f275da84243 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:40.248288 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-e4b162b0-2804-451f-bcc7-9f275da84243 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/ips" status: 200 len: 152 microversion: 2.20 time: 0.068827 Dec 15 16:28:40.249701 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 467/943] 10.222.0.60 () {60 vars in 1288 bytes} [Wed Dec 15 16:28:40 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/ips => generated 152 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:28:42.315942 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-17931168-1d39-4585-a39a-bdd443ac2805 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:28:42.316568 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-17931168-1d39-4585-a39a-bdd443ac2805 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:42.324029 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-17931168-1d39-4585-a39a-bdd443ac2805 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:42.324705 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-17931168-1d39-4585-a39a-bdd443ac2805 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:42.326277 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-17931168-1d39-4585-a39a-bdd443ac2805 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:42.328413 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-17931168-1d39-4585-a39a-bdd443ac2805 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:42.363982 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.objects.instance [None req-17931168-1d39-4585-a39a-bdd443ac2805 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lazy-loading 'flavor' on Instance uuid bfff70d8-7b03-417e-886b-1929e47645d5 {{(pid=116084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:28:42.722500 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-17931168-1d39-4585-a39a-bdd443ac2805 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action" status: 202 len: 0 microversion: 2.20 time: 0.410971 Dec 15 16:28:42.725476 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 477/944] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:28:42 2021] POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:28:42.735943 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-8080876b-7b04-4e12-9f5c-8ecc71a9a07c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:42.736908 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-8080876b-7b04-4e12-9f5c-8ecc71a9a07c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:42.745262 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8080876b-7b04-4e12-9f5c-8ecc71a9a07c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:42.746589 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8080876b-7b04-4e12-9f5c-8ecc71a9a07c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:42.747649 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8080876b-7b04-4e12-9f5c-8ecc71a9a07c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:42.749899 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-8080876b-7b04-4e12-9f5c-8ecc71a9a07c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:42.977804 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-8080876b-7b04-4e12-9f5c-8ecc71a9a07c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:42.991756 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-8080876b-7b04-4e12-9f5c-8ecc71a9a07c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:42.994727 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-8080876b-7b04-4e12-9f5c-8ecc71a9a07c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:42.997294 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-8080876b-7b04-4e12-9f5c-8ecc71a9a07c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 200 len: 1725 microversion: 2.20 time: 0.268805 Dec 15 16:28:43.002810 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 468/945] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:28:42 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 1725 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:28:44.022730 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0928b260-e745-41ce-bba3-5734a476db6a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:44.023558 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-0928b260-e745-41ce-bba3-5734a476db6a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:44.037880 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0928b260-e745-41ce-bba3-5734a476db6a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:44.038472 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0928b260-e745-41ce-bba3-5734a476db6a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:44.039349 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0928b260-e745-41ce-bba3-5734a476db6a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:44.039995 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0928b260-e745-41ce-bba3-5734a476db6a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:44.261915 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-0928b260-e745-41ce-bba3-5734a476db6a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:44.280350 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-0928b260-e745-41ce-bba3-5734a476db6a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:44.283490 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-0928b260-e745-41ce-bba3-5734a476db6a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:44.291576 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0928b260-e745-41ce-bba3-5734a476db6a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 200 len: 1725 microversion: 2.20 time: 0.271107 Dec 15 16:28:44.298518 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 478/946] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:28:44 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 1725 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:28:45.313110 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-479ae009-aa7b-4956-be16-32abb838325a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:45.313868 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-479ae009-aa7b-4956-be16-32abb838325a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:45.323481 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-479ae009-aa7b-4956-be16-32abb838325a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:45.324118 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-479ae009-aa7b-4956-be16-32abb838325a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:45.325144 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-479ae009-aa7b-4956-be16-32abb838325a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:45.326256 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-479ae009-aa7b-4956-be16-32abb838325a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:45.489193 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-479ae009-aa7b-4956-be16-32abb838325a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:45.498922 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-479ae009-aa7b-4956-be16-32abb838325a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:45.502068 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-479ae009-aa7b-4956-be16-32abb838325a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:45.503611 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-479ae009-aa7b-4956-be16-32abb838325a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 200 len: 1725 microversion: 2.20 time: 0.196376 Dec 15 16:28:45.504233 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 469/947] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:28:45 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 1725 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:28:46.522640 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-7ae7bb15-027e-4691-a553-7f290dd35c66 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:46.523251 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-7ae7bb15-027e-4691-a553-7f290dd35c66 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:46.530442 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7ae7bb15-027e-4691-a553-7f290dd35c66 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:46.530894 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7ae7bb15-027e-4691-a553-7f290dd35c66 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:46.532075 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7ae7bb15-027e-4691-a553-7f290dd35c66 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:46.532513 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7ae7bb15-027e-4691-a553-7f290dd35c66 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:46.692151 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-7ae7bb15-027e-4691-a553-7f290dd35c66 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:46.701017 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-7ae7bb15-027e-4691-a553-7f290dd35c66 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:46.702530 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-7ae7bb15-027e-4691-a553-7f290dd35c66 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:46.703841 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-7ae7bb15-027e-4691-a553-7f290dd35c66 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 200 len: 1725 microversion: 2.20 time: 0.185087 Dec 15 16:28:46.713558 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 479/948] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:28:46 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 1725 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:28:47.723651 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-a7ea1d50-60d2-4f3e-ab7a-2e4f216a2a81 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:47.724218 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-a7ea1d50-60d2-4f3e-ab7a-2e4f216a2a81 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:47.731128 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a7ea1d50-60d2-4f3e-ab7a-2e4f216a2a81 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:47.731640 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a7ea1d50-60d2-4f3e-ab7a-2e4f216a2a81 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:47.732425 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a7ea1d50-60d2-4f3e-ab7a-2e4f216a2a81 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:47.732855 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a7ea1d50-60d2-4f3e-ab7a-2e4f216a2a81 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:47.877942 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-a7ea1d50-60d2-4f3e-ab7a-2e4f216a2a81 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:47.888792 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-a7ea1d50-60d2-4f3e-ab7a-2e4f216a2a81 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:47.890493 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-a7ea1d50-60d2-4f3e-ab7a-2e4f216a2a81 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:47.892057 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-a7ea1d50-60d2-4f3e-ab7a-2e4f216a2a81 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 200 len: 1725 microversion: 2.20 time: 0.172873 Dec 15 16:28:47.892644 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 470/949] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:28:47 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:28:48.917670 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-81b4f2be-dd7d-4df9-a73b-5364de8e881a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:48.918271 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-81b4f2be-dd7d-4df9-a73b-5364de8e881a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:48.925255 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-81b4f2be-dd7d-4df9-a73b-5364de8e881a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:48.925712 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-81b4f2be-dd7d-4df9-a73b-5364de8e881a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:48.926504 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-81b4f2be-dd7d-4df9-a73b-5364de8e881a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:48.926939 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-81b4f2be-dd7d-4df9-a73b-5364de8e881a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:49.086022 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-81b4f2be-dd7d-4df9-a73b-5364de8e881a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:49.097859 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-81b4f2be-dd7d-4df9-a73b-5364de8e881a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:49.100111 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-81b4f2be-dd7d-4df9-a73b-5364de8e881a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:49.101946 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-81b4f2be-dd7d-4df9-a73b-5364de8e881a tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 200 len: 1725 microversion: 2.20 time: 0.187890 Dec 15 16:28:49.102625 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 480/950] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:28:48 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 1725 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:28:50.123480 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-080ae678-9c49-4ab9-87e9-f0cf0586c2a5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:50.124108 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-080ae678-9c49-4ab9-87e9-f0cf0586c2a5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:50.130971 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-080ae678-9c49-4ab9-87e9-f0cf0586c2a5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:50.131445 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-080ae678-9c49-4ab9-87e9-f0cf0586c2a5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:50.132239 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-080ae678-9c49-4ab9-87e9-f0cf0586c2a5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:50.132830 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-080ae678-9c49-4ab9-87e9-f0cf0586c2a5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:50.276155 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-080ae678-9c49-4ab9-87e9-f0cf0586c2a5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:50.284785 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-080ae678-9c49-4ab9-87e9-f0cf0586c2a5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:50.286294 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-080ae678-9c49-4ab9-87e9-f0cf0586c2a5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:50.287492 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-080ae678-9c49-4ab9-87e9-f0cf0586c2a5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 200 len: 1725 microversion: 2.20 time: 0.168076 Dec 15 16:28:50.288077 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 471/951] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:28:50 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:28:51.307193 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b16f2fb9-9fea-4af2-9cb5-6683732b748d tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:51.308153 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b16f2fb9-9fea-4af2-9cb5-6683732b748d tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:51.315300 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b16f2fb9-9fea-4af2-9cb5-6683732b748d tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:51.315753 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b16f2fb9-9fea-4af2-9cb5-6683732b748d tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:51.316748 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b16f2fb9-9fea-4af2-9cb5-6683732b748d tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:51.317252 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b16f2fb9-9fea-4af2-9cb5-6683732b748d tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:51.461613 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b16f2fb9-9fea-4af2-9cb5-6683732b748d tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:51.470049 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b16f2fb9-9fea-4af2-9cb5-6683732b748d tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:51.471846 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b16f2fb9-9fea-4af2-9cb5-6683732b748d tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:51.473026 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b16f2fb9-9fea-4af2-9cb5-6683732b748d tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 200 len: 1725 microversion: 2.20 time: 0.169911 Dec 15 16:28:51.473604 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 481/952] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:28:51 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:28:52.493427 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-aff175f3-20fa-4cb6-b1b6-165b255a567f tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:52.494198 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-aff175f3-20fa-4cb6-b1b6-165b255a567f tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:52.504249 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-aff175f3-20fa-4cb6-b1b6-165b255a567f tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:52.505013 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-aff175f3-20fa-4cb6-b1b6-165b255a567f tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:52.506820 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-aff175f3-20fa-4cb6-b1b6-165b255a567f tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:52.507411 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-aff175f3-20fa-4cb6-b1b6-165b255a567f tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:52.654654 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-aff175f3-20fa-4cb6-b1b6-165b255a567f tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:52.666896 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-aff175f3-20fa-4cb6-b1b6-165b255a567f tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:52.670399 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-aff175f3-20fa-4cb6-b1b6-165b255a567f tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:52.672749 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-aff175f3-20fa-4cb6-b1b6-165b255a567f tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 200 len: 1725 microversion: 2.20 time: 0.183156 Dec 15 16:28:52.673694 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 472/953] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:28:52 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 1725 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:28:53.692342 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1b20abdf-e66e-4b17-962c-d046a86088cc tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:53.693559 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1b20abdf-e66e-4b17-962c-d046a86088cc tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:53.699774 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1b20abdf-e66e-4b17-962c-d046a86088cc tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:53.700245 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1b20abdf-e66e-4b17-962c-d046a86088cc tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:53.701187 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1b20abdf-e66e-4b17-962c-d046a86088cc tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:53.701645 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1b20abdf-e66e-4b17-962c-d046a86088cc tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:53.837801 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1b20abdf-e66e-4b17-962c-d046a86088cc tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:53.847292 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1b20abdf-e66e-4b17-962c-d046a86088cc tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:53.849023 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1b20abdf-e66e-4b17-962c-d046a86088cc tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:53.850197 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1b20abdf-e66e-4b17-962c-d046a86088cc tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 200 len: 1746 microversion: 2.20 time: 0.161929 Dec 15 16:28:53.850759 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 482/954] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:28:53 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 1746 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:28:54.872165 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-ba52e301-e6e1-40ec-b7ee-f08ca6f34a64 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:54.872866 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-ba52e301-e6e1-40ec-b7ee-f08ca6f34a64 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:54.881567 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ba52e301-e6e1-40ec-b7ee-f08ca6f34a64 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:54.882017 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ba52e301-e6e1-40ec-b7ee-f08ca6f34a64 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:54.882820 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ba52e301-e6e1-40ec-b7ee-f08ca6f34a64 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:54.883952 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ba52e301-e6e1-40ec-b7ee-f08ca6f34a64 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:55.038429 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-ba52e301-e6e1-40ec-b7ee-f08ca6f34a64 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:55.046805 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-ba52e301-e6e1-40ec-b7ee-f08ca6f34a64 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:55.048443 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-ba52e301-e6e1-40ec-b7ee-f08ca6f34a64 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:55.049608 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-ba52e301-e6e1-40ec-b7ee-f08ca6f34a64 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 200 len: 1741 microversion: 2.20 time: 0.183247 Dec 15 16:28:55.062072 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 473/955] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:28:54 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 1741 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:28:56.068630 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-063f21a1-8ec7-4424-8854-9579504e0ab0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:56.069542 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-063f21a1-8ec7-4424-8854-9579504e0ab0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:56.076488 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-063f21a1-8ec7-4424-8854-9579504e0ab0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:56.077257 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-063f21a1-8ec7-4424-8854-9579504e0ab0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:56.078187 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-063f21a1-8ec7-4424-8854-9579504e0ab0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:56.078728 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-063f21a1-8ec7-4424-8854-9579504e0ab0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:56.246804 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-063f21a1-8ec7-4424-8854-9579504e0ab0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:56.256004 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-063f21a1-8ec7-4424-8854-9579504e0ab0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:56.257706 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-063f21a1-8ec7-4424-8854-9579504e0ab0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:56.258863 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-063f21a1-8ec7-4424-8854-9579504e0ab0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 200 len: 1741 microversion: 2.20 time: 0.194552 Dec 15 16:28:56.269889 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 483/956] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:28:56 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 1741 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:28:57.199087 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-0ef53ad0-6c0a-455f-8623-4a51e9bc33a5 req-42c0f6bd-fdac-44cd-83e3-ababf5446aa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfff70d8-7b03-417e-886b-1929e47645d5", "name": "network-vif-plugged", "status": "completed", "tag": "2e6e772a-f992-461a-881b-dffbf851deca"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:28:57.202799 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:28:57.202799 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Dec 15 16:28:57.226567 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-0ef53ad0-6c0a-455f-8623-4a51e9bc33a5 req-42c0f6bd-fdac-44cd-83e3-ababf5446aa9 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:57.227287 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-0ef53ad0-6c0a-455f-8623-4a51e9bc33a5 req-42c0f6bd-fdac-44cd-83e3-ababf5446aa9 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:57.284190 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-7ec4d7eb-eca4-43e6-b697-58b506a3f086 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:57.284190 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-7ec4d7eb-eca4-43e6-b697-58b506a3f086 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:57.292839 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-0ef53ad0-6c0a-455f-8623-4a51e9bc33a5 req-42c0f6bd-fdac-44cd-83e3-ababf5446aa9 service nova] Creating event network-vif-plugged:2e6e772a-f992-461a-881b-dffbf851deca for instance bfff70d8-7b03-417e-886b-1929e47645d5 on hv-cinder-81268 Dec 15 16:28:57.302228 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-0ef53ad0-6c0a-455f-8623-4a51e9bc33a5 req-42c0f6bd-fdac-44cd-83e3-ababf5446aa9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108014 Dec 15 16:28:57.303315 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 474/957] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:28:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:28:57.306891 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7ec4d7eb-eca4-43e6-b697-58b506a3f086 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:57.307344 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7ec4d7eb-eca4-43e6-b697-58b506a3f086 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:57.308174 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7ec4d7eb-eca4-43e6-b697-58b506a3f086 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:57.308804 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7ec4d7eb-eca4-43e6-b697-58b506a3f086 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:57.523051 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-7ec4d7eb-eca4-43e6-b697-58b506a3f086 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:57.531809 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-7ec4d7eb-eca4-43e6-b697-58b506a3f086 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:57.534002 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-7ec4d7eb-eca4-43e6-b697-58b506a3f086 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:57.535509 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-7ec4d7eb-eca4-43e6-b697-58b506a3f086 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 200 len: 1741 microversion: 2.20 time: 0.260946 Dec 15 16:28:57.536801 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 484/958] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:28:57 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 1741 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:28:58.558697 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-f5ef3c51-9c78-489b-8459-d9189c0d4a1b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:58.560625 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-f5ef3c51-9c78-489b-8459-d9189c0d4a1b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:58.572452 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f5ef3c51-9c78-489b-8459-d9189c0d4a1b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:58.573186 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f5ef3c51-9c78-489b-8459-d9189c0d4a1b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:58.574291 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f5ef3c51-9c78-489b-8459-d9189c0d4a1b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:58.574992 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-f5ef3c51-9c78-489b-8459-d9189c0d4a1b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:58.827423 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-f5ef3c51-9c78-489b-8459-d9189c0d4a1b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:58.836848 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-f5ef3c51-9c78-489b-8459-d9189c0d4a1b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:58.838824 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-f5ef3c51-9c78-489b-8459-d9189c0d4a1b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:28:58.840237 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-f5ef3c51-9c78-489b-8459-d9189c0d4a1b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 200 len: 1741 microversion: 2.20 time: 0.289223 Dec 15 16:28:58.840987 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 475/959] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:28:58 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 1741 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:28:59.858921 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ef08ab23-c1ef-4ad4-b59d-484ba5f65367 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:28:59.860199 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ef08ab23-c1ef-4ad4-b59d-484ba5f65367 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:28:59.874803 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ef08ab23-c1ef-4ad4-b59d-484ba5f65367 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:59.875137 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ef08ab23-c1ef-4ad4-b59d-484ba5f65367 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:28:59.875959 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ef08ab23-c1ef-4ad4-b59d-484ba5f65367 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:28:59.876616 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ef08ab23-c1ef-4ad4-b59d-484ba5f65367 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:00.073352 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ef08ab23-c1ef-4ad4-b59d-484ba5f65367 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:00.083073 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ef08ab23-c1ef-4ad4-b59d-484ba5f65367 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:00.085170 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ef08ab23-c1ef-4ad4-b59d-484ba5f65367 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:00.086338 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ef08ab23-c1ef-4ad4-b59d-484ba5f65367 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 200 len: 1741 microversion: 2.20 time: 0.231319 Dec 15 16:29:00.087108 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 485/960] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:28:59 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 1741 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:29:01.106304 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-7f3fe156-43ed-4a7c-a69a-97985b720c8f tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:01.106942 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-7f3fe156-43ed-4a7c-a69a-97985b720c8f tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:01.116178 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7f3fe156-43ed-4a7c-a69a-97985b720c8f tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:01.116684 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7f3fe156-43ed-4a7c-a69a-97985b720c8f tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:01.117605 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7f3fe156-43ed-4a7c-a69a-97985b720c8f tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:01.118073 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7f3fe156-43ed-4a7c-a69a-97985b720c8f tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:01.285971 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-7f3fe156-43ed-4a7c-a69a-97985b720c8f tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:01.295362 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-7f3fe156-43ed-4a7c-a69a-97985b720c8f tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:01.297069 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-7f3fe156-43ed-4a7c-a69a-97985b720c8f tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:01.298269 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-7f3fe156-43ed-4a7c-a69a-97985b720c8f tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 200 len: 1741 microversion: 2.20 time: 0.195869 Dec 15 16:29:01.310530 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 476/961] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:29:01 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 1741 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:29:02.318902 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-03c1aae3-5d72-4934-9f25-e395f0116c73 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:02.319779 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-03c1aae3-5d72-4934-9f25-e395f0116c73 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:02.325997 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-03c1aae3-5d72-4934-9f25-e395f0116c73 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:02.326701 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-03c1aae3-5d72-4934-9f25-e395f0116c73 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:02.334334 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-03c1aae3-5d72-4934-9f25-e395f0116c73 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:02.334938 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-03c1aae3-5d72-4934-9f25-e395f0116c73 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:02.481624 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-03c1aae3-5d72-4934-9f25-e395f0116c73 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:02.492560 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-03c1aae3-5d72-4934-9f25-e395f0116c73 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:02.494393 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-03c1aae3-5d72-4934-9f25-e395f0116c73 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:02.495809 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-03c1aae3-5d72-4934-9f25-e395f0116c73 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 200 len: 1741 microversion: 2.20 time: 0.182160 Dec 15 16:29:02.496383 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 486/962] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:29:02 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 1741 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:29:03.514734 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-73c0853b-e96e-43d7-a71b-9b0d69e150f6 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:03.515404 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-73c0853b-e96e-43d7-a71b-9b0d69e150f6 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:03.526531 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-73c0853b-e96e-43d7-a71b-9b0d69e150f6 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:03.527278 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-73c0853b-e96e-43d7-a71b-9b0d69e150f6 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:03.528108 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-73c0853b-e96e-43d7-a71b-9b0d69e150f6 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:03.528534 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-73c0853b-e96e-43d7-a71b-9b0d69e150f6 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:03.750306 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-73c0853b-e96e-43d7-a71b-9b0d69e150f6 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:03.811393 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-73c0853b-e96e-43d7-a71b-9b0d69e150f6 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:03.813443 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-73c0853b-e96e-43d7-a71b-9b0d69e150f6 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:03.815195 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-73c0853b-e96e-43d7-a71b-9b0d69e150f6 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 200 len: 1741 microversion: 2.20 time: 0.304800 Dec 15 16:29:03.826454 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 477/963] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:29:03 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 1741 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:29:04.833767 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1e0d7460-1c38-4485-b9ba-337b230ad798 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:04.834366 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1e0d7460-1c38-4485-b9ba-337b230ad798 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:04.841213 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1e0d7460-1c38-4485-b9ba-337b230ad798 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:04.841695 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1e0d7460-1c38-4485-b9ba-337b230ad798 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:04.842472 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1e0d7460-1c38-4485-b9ba-337b230ad798 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:04.842991 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1e0d7460-1c38-4485-b9ba-337b230ad798 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:04.979696 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1e0d7460-1c38-4485-b9ba-337b230ad798 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:04.988342 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1e0d7460-1c38-4485-b9ba-337b230ad798 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:04.989823 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1e0d7460-1c38-4485-b9ba-337b230ad798 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:04.990974 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1e0d7460-1c38-4485-b9ba-337b230ad798 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 200 len: 1741 microversion: 2.20 time: 0.161468 Dec 15 16:29:04.991559 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 487/964] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:29:04 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 1741 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:29:06.010742 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-ecfa0442-0fee-47d0-8303-81540f7625dd tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:06.011345 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-ecfa0442-0fee-47d0-8303-81540f7625dd tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:06.018303 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ecfa0442-0fee-47d0-8303-81540f7625dd tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:06.018752 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ecfa0442-0fee-47d0-8303-81540f7625dd tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:06.019564 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ecfa0442-0fee-47d0-8303-81540f7625dd tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:06.019970 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ecfa0442-0fee-47d0-8303-81540f7625dd tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:06.156980 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-ecfa0442-0fee-47d0-8303-81540f7625dd tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:06.166266 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-ecfa0442-0fee-47d0-8303-81540f7625dd tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:06.167849 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-ecfa0442-0fee-47d0-8303-81540f7625dd tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:06.169023 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-ecfa0442-0fee-47d0-8303-81540f7625dd tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 200 len: 1723 microversion: 2.20 time: 0.162253 Dec 15 16:29:06.170803 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 478/965] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:29:06 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:29:07.191419 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e25865af-e878-49ff-9130-2a301a978e35 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:07.192760 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e25865af-e878-49ff-9130-2a301a978e35 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:07.199020 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e25865af-e878-49ff-9130-2a301a978e35 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:07.199506 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e25865af-e878-49ff-9130-2a301a978e35 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:07.200280 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e25865af-e878-49ff-9130-2a301a978e35 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:07.200916 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e25865af-e878-49ff-9130-2a301a978e35 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:07.345794 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e25865af-e878-49ff-9130-2a301a978e35 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:07.355028 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e25865af-e878-49ff-9130-2a301a978e35 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:07.356564 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e25865af-e878-49ff-9130-2a301a978e35 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:07.357926 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e25865af-e878-49ff-9130-2a301a978e35 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 200 len: 1723 microversion: 2.20 time: 0.170480 Dec 15 16:29:07.358916 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 488/966] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:29:07 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:29:08.377971 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-325ed921-c03e-4350-9b8d-a349d172b0a3 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:08.378579 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-325ed921-c03e-4350-9b8d-a349d172b0a3 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:08.385386 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-325ed921-c03e-4350-9b8d-a349d172b0a3 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:08.385819 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-325ed921-c03e-4350-9b8d-a349d172b0a3 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:08.386629 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-325ed921-c03e-4350-9b8d-a349d172b0a3 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:08.387054 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-325ed921-c03e-4350-9b8d-a349d172b0a3 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:08.534800 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-325ed921-c03e-4350-9b8d-a349d172b0a3 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:08.542799 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-325ed921-c03e-4350-9b8d-a349d172b0a3 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:08.544327 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-325ed921-c03e-4350-9b8d-a349d172b0a3 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:08.545491 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-325ed921-c03e-4350-9b8d-a349d172b0a3 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 200 len: 1666 microversion: 2.20 time: 0.171613 Dec 15 16:29:08.550689 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 479/967] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:29:08 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 1666 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:29:08.564888 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-8640e5c8-769a-4866-abda-b4080ae06c32 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3225967a-5a0f-4fb1-984a-74e6f9183a3e"}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:29:08.566107 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-8640e5c8-769a-4866-abda-b4080ae06c32 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:08.573059 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8640e5c8-769a-4866-abda-b4080ae06c32 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:08.573509 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8640e5c8-769a-4866-abda-b4080ae06c32 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:08.574287 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8640e5c8-769a-4866-abda-b4080ae06c32 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:08.574717 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8640e5c8-769a-4866-abda-b4080ae06c32 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:08.866389 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-8640e5c8-769a-4866-abda-b4080ae06c32 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.305539 Dec 15 16:29:08.867128 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 489/968] 10.222.0.60 () {62 vars in 1363 bytes} [Wed Dec 15 16:29:08 2021] POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/os-volume_attachments => generated 188 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 15 16:29:08.985832 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-5e588b1e-f3b6-4716-a46c-7b1da3fc3092 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:08.986433 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-5e588b1e-f3b6-4716-a46c-7b1da3fc3092 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:08.993035 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5e588b1e-f3b6-4716-a46c-7b1da3fc3092 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:08.993482 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5e588b1e-f3b6-4716-a46c-7b1da3fc3092 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:08.994268 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5e588b1e-f3b6-4716-a46c-7b1da3fc3092 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:08.994704 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5e588b1e-f3b6-4716-a46c-7b1da3fc3092 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:09.081416 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-bdbf8e6c-683e-4527-af24-b8787b685547 req-593be894-976f-4df1-b383-c47282929c5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfff70d8-7b03-417e-886b-1929e47645d5", "name": "network-vif-unplugged", "status": "completed", "tag": "2e6e772a-f992-461a-881b-dffbf851deca"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:29:09.083246 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:29:09.083246 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:29:09.092178 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-bdbf8e6c-683e-4527-af24-b8787b685547 req-593be894-976f-4df1-b383-c47282929c5a service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:09.092819 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-bdbf8e6c-683e-4527-af24-b8787b685547 req-593be894-976f-4df1-b383-c47282929c5a service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:09.107728 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.compute.server_external_events [req-bdbf8e6c-683e-4527-af24-b8787b685547 req-593be894-976f-4df1-b383-c47282929c5a service nova] Unable to find a host for instance bfff70d8-7b03-417e-886b-1929e47645d5. Dropping event network-vif-unplugged {{(pid=116084) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Dec 15 16:29:09.108631 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-bdbf8e6c-683e-4527-af24-b8787b685547 req-593be894-976f-4df1-b383-c47282929c5a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031271 Dec 15 16:29:09.109434 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 490/969] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:29:09 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Dec 15 16:29:09.255929 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-5e588b1e-f3b6-4716-a46c-7b1da3fc3092 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "DELETE /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/os-volume_attachments/3225967a-5a0f-4fb1-984a-74e6f9183a3e" status: 202 len: 0 microversion: 2.20 time: 0.273878 Dec 15 16:29:09.256759 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 480/970] 10.222.0.60 () {60 vars in 1456 bytes} [Wed Dec 15 16:29:08 2021] DELETE /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/os-volume_attachments/3225967a-5a0f-4fb1-984a-74e6f9183a3e => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:29:09.316880 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e9e4404b-c73d-48fb-b9a7-21e12b28cea4 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:29:09.317455 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e9e4404b-c73d-48fb-b9a7-21e12b28cea4 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:09.324801 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e9e4404b-c73d-48fb-b9a7-21e12b28cea4 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:09.325327 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e9e4404b-c73d-48fb-b9a7-21e12b28cea4 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:09.326119 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e9e4404b-c73d-48fb-b9a7-21e12b28cea4 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:09.326554 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e9e4404b-c73d-48fb-b9a7-21e12b28cea4 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:09.410826 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e9e4404b-c73d-48fb-b9a7-21e12b28cea4 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action" status: 202 len: 0 microversion: 2.20 time: 0.099530 Dec 15 16:29:09.411908 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 491/971] 10.222.0.60 () {62 vars in 1318 bytes} [Wed Dec 15 16:29:09 2021] POST /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:29:09.423903 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-b68b9e0e-64b6-4202-b994-a111f71e53f0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:09.424515 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-b68b9e0e-64b6-4202-b994-a111f71e53f0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:09.431089 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b68b9e0e-64b6-4202-b994-a111f71e53f0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:09.431570 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b68b9e0e-64b6-4202-b994-a111f71e53f0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:09.432355 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b68b9e0e-64b6-4202-b994-a111f71e53f0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:09.432798 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b68b9e0e-64b6-4202-b994-a111f71e53f0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:09.566814 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-b68b9e0e-64b6-4202-b994-a111f71e53f0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:09.575308 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-b68b9e0e-64b6-4202-b994-a111f71e53f0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:09.577038 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-b68b9e0e-64b6-4202-b994-a111f71e53f0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:09.578436 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-b68b9e0e-64b6-4202-b994-a111f71e53f0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 200 len: 1674 microversion: 2.20 time: 0.160625 Dec 15 16:29:09.579318 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 481/972] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:29:09 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:29:10.600178 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0466c0d1-d90b-4996-80b1-c748f01affce tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:10.600817 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-0466c0d1-d90b-4996-80b1-c748f01affce tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:10.609421 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0466c0d1-d90b-4996-80b1-c748f01affce tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:10.609982 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0466c0d1-d90b-4996-80b1-c748f01affce tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:10.611467 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0466c0d1-d90b-4996-80b1-c748f01affce tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:10.611655 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0466c0d1-d90b-4996-80b1-c748f01affce tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:10.757945 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-0466c0d1-d90b-4996-80b1-c748f01affce tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:10.766748 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-0466c0d1-d90b-4996-80b1-c748f01affce tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:10.768522 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-0466c0d1-d90b-4996-80b1-c748f01affce tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:10.769677 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0466c0d1-d90b-4996-80b1-c748f01affce tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 200 len: 1674 microversion: 2.20 time: 0.174655 Dec 15 16:29:10.770231 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 492/973] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:29:10 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 1674 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:29:11.789121 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-d2663f2e-015d-4245-b3e7-3d45f0a2fd61 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:11.792122 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-d2663f2e-015d-4245-b3e7-3d45f0a2fd61 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:11.798249 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d2663f2e-015d-4245-b3e7-3d45f0a2fd61 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:11.798999 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d2663f2e-015d-4245-b3e7-3d45f0a2fd61 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:11.801147 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d2663f2e-015d-4245-b3e7-3d45f0a2fd61 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:11.801311 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d2663f2e-015d-4245-b3e7-3d45f0a2fd61 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:11.946722 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-d2663f2e-015d-4245-b3e7-3d45f0a2fd61 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:11.954992 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-d2663f2e-015d-4245-b3e7-3d45f0a2fd61 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:11.956615 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-d2663f2e-015d-4245-b3e7-3d45f0a2fd61 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:11.957938 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-d2663f2e-015d-4245-b3e7-3d45f0a2fd61 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 200 len: 1674 microversion: 2.20 time: 0.172806 Dec 15 16:29:11.959328 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 482/974] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:29:11 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 1674 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:29:12.976634 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-69e1cd4e-9309-4849-bfc9-084c11c0c1ab tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:12.977303 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-69e1cd4e-9309-4849-bfc9-084c11c0c1ab tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:12.983834 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-69e1cd4e-9309-4849-bfc9-084c11c0c1ab tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:12.984280 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-69e1cd4e-9309-4849-bfc9-084c11c0c1ab tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:12.985054 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-69e1cd4e-9309-4849-bfc9-084c11c0c1ab tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:12.985477 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-69e1cd4e-9309-4849-bfc9-084c11c0c1ab tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:13.129927 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-69e1cd4e-9309-4849-bfc9-084c11c0c1ab tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:13.142671 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-69e1cd4e-9309-4849-bfc9-084c11c0c1ab tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:13.145048 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-69e1cd4e-9309-4849-bfc9-084c11c0c1ab tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:13.146274 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-69e1cd4e-9309-4849-bfc9-084c11c0c1ab tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 200 len: 1674 microversion: 2.20 time: 0.173697 Dec 15 16:29:13.146889 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 493/975] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:29:12 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 1674 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:29:14.169648 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-247160c2-9fb6-47d3-83af-3660a6d01a3c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:14.170672 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-247160c2-9fb6-47d3-83af-3660a6d01a3c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:14.182388 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-247160c2-9fb6-47d3-83af-3660a6d01a3c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:14.183141 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-247160c2-9fb6-47d3-83af-3660a6d01a3c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:14.184432 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-247160c2-9fb6-47d3-83af-3660a6d01a3c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:14.185161 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-247160c2-9fb6-47d3-83af-3660a6d01a3c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:14.328292 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-247160c2-9fb6-47d3-83af-3660a6d01a3c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:14.335922 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-247160c2-9fb6-47d3-83af-3660a6d01a3c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:14.337487 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-247160c2-9fb6-47d3-83af-3660a6d01a3c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:14.338552 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-247160c2-9fb6-47d3-83af-3660a6d01a3c tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 200 len: 1674 microversion: 2.20 time: 0.173002 Dec 15 16:29:14.339113 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 483/976] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:29:14 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 1674 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:29:15.358229 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-4869d5a5-fa9e-47a8-a930-5a3b6ebc5403 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:15.358858 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-4869d5a5-fa9e-47a8-a930-5a3b6ebc5403 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:15.366530 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4869d5a5-fa9e-47a8-a930-5a3b6ebc5403 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:15.367034 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4869d5a5-fa9e-47a8-a930-5a3b6ebc5403 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:15.367888 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4869d5a5-fa9e-47a8-a930-5a3b6ebc5403 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:15.368321 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4869d5a5-fa9e-47a8-a930-5a3b6ebc5403 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:15.510646 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-4869d5a5-fa9e-47a8-a930-5a3b6ebc5403 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:15.518889 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-4869d5a5-fa9e-47a8-a930-5a3b6ebc5403 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:15.520396 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-4869d5a5-fa9e-47a8-a930-5a3b6ebc5403 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:15.522330 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-4869d5a5-fa9e-47a8-a930-5a3b6ebc5403 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 200 len: 1674 microversion: 2.20 time: 0.168850 Dec 15 16:29:15.522902 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 494/977] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:29:15 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 1674 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:29:16.541933 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-9de48761-86e4-4004-aa37-08fe69057543 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:16.542423 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-9de48761-86e4-4004-aa37-08fe69057543 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:16.548658 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9de48761-86e4-4004-aa37-08fe69057543 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:16.549103 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9de48761-86e4-4004-aa37-08fe69057543 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:16.549885 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9de48761-86e4-4004-aa37-08fe69057543 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:16.550504 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9de48761-86e4-4004-aa37-08fe69057543 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:16.697561 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-9de48761-86e4-4004-aa37-08fe69057543 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:16.706071 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-9de48761-86e4-4004-aa37-08fe69057543 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:16.707618 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-9de48761-86e4-4004-aa37-08fe69057543 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:16.708918 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-9de48761-86e4-4004-aa37-08fe69057543 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 200 len: 1732 microversion: 2.20 time: 0.171584 Dec 15 16:29:16.709505 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 484/978] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:29:16 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:29:17.738263 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-13fe4a10-b020-4172-9383-77dbf9bd55b9 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:17.738929 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-13fe4a10-b020-4172-9383-77dbf9bd55b9 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:17.745805 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-13fe4a10-b020-4172-9383-77dbf9bd55b9 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:17.746261 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-13fe4a10-b020-4172-9383-77dbf9bd55b9 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:17.747090 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-13fe4a10-b020-4172-9383-77dbf9bd55b9 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:17.747554 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-13fe4a10-b020-4172-9383-77dbf9bd55b9 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:17.891050 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-13fe4a10-b020-4172-9383-77dbf9bd55b9 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:17.899819 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-13fe4a10-b020-4172-9383-77dbf9bd55b9 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:17.901746 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-13fe4a10-b020-4172-9383-77dbf9bd55b9 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:17.903127 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-13fe4a10-b020-4172-9383-77dbf9bd55b9 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 200 len: 1732 microversion: 2.20 time: 0.169078 Dec 15 16:29:17.914919 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 495/979] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:29:17 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 1732 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:29:18.925972 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-3f8d9abf-5811-4433-b42f-9338313e2da4 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:18.926876 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-3f8d9abf-5811-4433-b42f-9338313e2da4 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:18.934728 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3f8d9abf-5811-4433-b42f-9338313e2da4 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:18.935174 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3f8d9abf-5811-4433-b42f-9338313e2da4 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:18.936073 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3f8d9abf-5811-4433-b42f-9338313e2da4 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:18.936509 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3f8d9abf-5811-4433-b42f-9338313e2da4 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:19.317020 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-3f8d9abf-5811-4433-b42f-9338313e2da4 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:19.326687 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-3f8d9abf-5811-4433-b42f-9338313e2da4 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:19.328243 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-3f8d9abf-5811-4433-b42f-9338313e2da4 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:19.329447 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-3f8d9abf-5811-4433-b42f-9338313e2da4 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 200 len: 1732 microversion: 2.20 time: 0.410085 Dec 15 16:29:19.329986 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 485/980] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:29:18 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 1732 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:29:20.348083 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-6300e24e-b4ae-4f53-a6ed-3e2feb708ec1 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:20.348693 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-6300e24e-b4ae-4f53-a6ed-3e2feb708ec1 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:20.355084 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6300e24e-b4ae-4f53-a6ed-3e2feb708ec1 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:20.355558 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6300e24e-b4ae-4f53-a6ed-3e2feb708ec1 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:20.356347 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6300e24e-b4ae-4f53-a6ed-3e2feb708ec1 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:20.356776 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-6300e24e-b4ae-4f53-a6ed-3e2feb708ec1 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:20.495858 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-6300e24e-b4ae-4f53-a6ed-3e2feb708ec1 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:20.504502 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-6300e24e-b4ae-4f53-a6ed-3e2feb708ec1 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:20.505988 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-6300e24e-b4ae-4f53-a6ed-3e2feb708ec1 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:20.507186 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-6300e24e-b4ae-4f53-a6ed-3e2feb708ec1 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 200 len: 1732 microversion: 2.20 time: 0.162938 Dec 15 16:29:20.507777 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 496/981] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:29:20 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:29:21.526323 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-025fd68f-5430-4b6f-aa00-0de6afd5e6f8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:21.528059 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-025fd68f-5430-4b6f-aa00-0de6afd5e6f8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:21.533057 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-025fd68f-5430-4b6f-aa00-0de6afd5e6f8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:21.533472 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-025fd68f-5430-4b6f-aa00-0de6afd5e6f8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:21.534245 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-025fd68f-5430-4b6f-aa00-0de6afd5e6f8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:21.534665 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-025fd68f-5430-4b6f-aa00-0de6afd5e6f8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:21.701684 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-025fd68f-5430-4b6f-aa00-0de6afd5e6f8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:21.710087 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-025fd68f-5430-4b6f-aa00-0de6afd5e6f8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:21.711594 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-025fd68f-5430-4b6f-aa00-0de6afd5e6f8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:21.713102 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-025fd68f-5430-4b6f-aa00-0de6afd5e6f8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 200 len: 1732 microversion: 2.20 time: 0.190844 Dec 15 16:29:21.713664 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 486/982] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:29:21 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 1732 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:29:22.537925 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:29:22.538949 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: Wed Dec 15 16:29:22 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:29:22.735755 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-2248dd6b-34a7-4377-a9f3-4e415c59df77 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:22.737552 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-2248dd6b-34a7-4377-a9f3-4e415c59df77 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:22.750919 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2248dd6b-34a7-4377-a9f3-4e415c59df77 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:22.751733 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2248dd6b-34a7-4377-a9f3-4e415c59df77 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:22.752686 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2248dd6b-34a7-4377-a9f3-4e415c59df77 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:22.753113 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2248dd6b-34a7-4377-a9f3-4e415c59df77 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:22.907495 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-2248dd6b-34a7-4377-a9f3-4e415c59df77 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:22.915976 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-2248dd6b-34a7-4377-a9f3-4e415c59df77 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:22.917656 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-2248dd6b-34a7-4377-a9f3-4e415c59df77 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:22.918812 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-2248dd6b-34a7-4377-a9f3-4e415c59df77 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 200 len: 1732 microversion: 2.20 time: 0.188914 Dec 15 16:29:22.919654 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 497/983] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:29:22 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 1732 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:29:23.939519 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-1088ff40-4983-4e0d-a42a-39c6aa314eb0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:23.940166 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-1088ff40-4983-4e0d-a42a-39c6aa314eb0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:23.946767 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1088ff40-4983-4e0d-a42a-39c6aa314eb0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:23.947103 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1088ff40-4983-4e0d-a42a-39c6aa314eb0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:23.948085 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1088ff40-4983-4e0d-a42a-39c6aa314eb0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:23.948581 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1088ff40-4983-4e0d-a42a-39c6aa314eb0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:24.092507 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-1088ff40-4983-4e0d-a42a-39c6aa314eb0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:24.102005 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-1088ff40-4983-4e0d-a42a-39c6aa314eb0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:24.104331 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-1088ff40-4983-4e0d-a42a-39c6aa314eb0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:24.105991 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-1088ff40-4983-4e0d-a42a-39c6aa314eb0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 200 len: 1732 microversion: 2.20 time: 0.170649 Dec 15 16:29:24.106631 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 487/984] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:29:23 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 1732 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:29:25.142783 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-f01b1502-6188-4be4-ae26-ed631462f5e0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:25.152395 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-f01b1502-6188-4be4-ae26-ed631462f5e0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:25.161161 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f01b1502-6188-4be4-ae26-ed631462f5e0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:25.161619 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f01b1502-6188-4be4-ae26-ed631462f5e0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:25.162435 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f01b1502-6188-4be4-ae26-ed631462f5e0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:25.162870 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-f01b1502-6188-4be4-ae26-ed631462f5e0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:25.319200 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f01b1502-6188-4be4-ae26-ed631462f5e0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:25.332201 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f01b1502-6188-4be4-ae26-ed631462f5e0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:25.332201 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-f01b1502-6188-4be4-ae26-ed631462f5e0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:25.332201 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-f01b1502-6188-4be4-ae26-ed631462f5e0 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 200 len: 1732 microversion: 2.20 time: 0.210070 Dec 15 16:29:25.332622 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 498/985] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:29:25 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 1732 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:29:26.352382 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-2a7284cb-54b3-432a-9ece-0d2372d4c6da tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:26.353233 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-2a7284cb-54b3-432a-9ece-0d2372d4c6da tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:26.359705 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2a7284cb-54b3-432a-9ece-0d2372d4c6da tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:26.360159 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2a7284cb-54b3-432a-9ece-0d2372d4c6da tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:26.360955 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2a7284cb-54b3-432a-9ece-0d2372d4c6da tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:26.361388 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-2a7284cb-54b3-432a-9ece-0d2372d4c6da tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:26.503673 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-2a7284cb-54b3-432a-9ece-0d2372d4c6da tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:26.516408 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-2a7284cb-54b3-432a-9ece-0d2372d4c6da tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:26.519730 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-2a7284cb-54b3-432a-9ece-0d2372d4c6da tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:26.521601 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-2a7284cb-54b3-432a-9ece-0d2372d4c6da tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 200 len: 1732 microversion: 2.20 time: 0.173065 Dec 15 16:29:26.523155 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 488/986] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:29:26 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 1732 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:29:27.541027 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-4d7a3a8f-fe16-44c1-936f-f182e195407b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:27.541637 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-4d7a3a8f-fe16-44c1-936f-f182e195407b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:27.548382 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4d7a3a8f-fe16-44c1-936f-f182e195407b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:27.548788 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4d7a3a8f-fe16-44c1-936f-f182e195407b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:27.549829 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4d7a3a8f-fe16-44c1-936f-f182e195407b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:27.550257 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4d7a3a8f-fe16-44c1-936f-f182e195407b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:27.692761 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-4d7a3a8f-fe16-44c1-936f-f182e195407b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:27.700868 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-4d7a3a8f-fe16-44c1-936f-f182e195407b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:27.702399 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-4d7a3a8f-fe16-44c1-936f-f182e195407b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:27.703699 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-4d7a3a8f-fe16-44c1-936f-f182e195407b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 200 len: 1732 microversion: 2.20 time: 0.166841 Dec 15 16:29:27.704271 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 499/987] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:29:27 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:29:28.724344 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-89e259de-efb1-4368-b7bc-1599deab7af7 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:28.725348 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-89e259de-efb1-4368-b7bc-1599deab7af7 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:28.735856 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-89e259de-efb1-4368-b7bc-1599deab7af7 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:28.736480 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-89e259de-efb1-4368-b7bc-1599deab7af7 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:28.737756 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-89e259de-efb1-4368-b7bc-1599deab7af7 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:28.738770 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-89e259de-efb1-4368-b7bc-1599deab7af7 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:28.891095 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-89e259de-efb1-4368-b7bc-1599deab7af7 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:28.900212 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-89e259de-efb1-4368-b7bc-1599deab7af7 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:28.901736 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-89e259de-efb1-4368-b7bc-1599deab7af7 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:28.902936 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-89e259de-efb1-4368-b7bc-1599deab7af7 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 200 len: 1732 microversion: 2.20 time: 0.184163 Dec 15 16:29:28.903664 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 489/988] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:29:28 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 1732 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:29:29.927944 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-da194cf2-2576-4d62-a3ae-335d86f87364 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:29.928746 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-da194cf2-2576-4d62-a3ae-335d86f87364 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:29.936106 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-da194cf2-2576-4d62-a3ae-335d86f87364 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:29.936676 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-da194cf2-2576-4d62-a3ae-335d86f87364 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:29.937584 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-da194cf2-2576-4d62-a3ae-335d86f87364 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:29.938033 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-da194cf2-2576-4d62-a3ae-335d86f87364 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:30.089747 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-da194cf2-2576-4d62-a3ae-335d86f87364 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:30.098186 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-da194cf2-2576-4d62-a3ae-335d86f87364 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:30.099707 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-da194cf2-2576-4d62-a3ae-335d86f87364 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:30.100889 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-da194cf2-2576-4d62-a3ae-335d86f87364 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 200 len: 1732 microversion: 2.20 time: 0.178424 Dec 15 16:29:30.101474 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 500/989] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:29:29 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 1732 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:29:31.121919 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-01c703a9-425c-453a-928b-cedb4517a1b5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:31.122513 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-01c703a9-425c-453a-928b-cedb4517a1b5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:31.131208 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-01c703a9-425c-453a-928b-cedb4517a1b5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:31.131697 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-01c703a9-425c-453a-928b-cedb4517a1b5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:31.132493 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-01c703a9-425c-453a-928b-cedb4517a1b5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:31.132938 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-01c703a9-425c-453a-928b-cedb4517a1b5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:31.283024 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-01c703a9-425c-453a-928b-cedb4517a1b5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:31.295331 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-01c703a9-425c-453a-928b-cedb4517a1b5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:31.297601 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-01c703a9-425c-453a-928b-cedb4517a1b5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:31.298794 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-01c703a9-425c-453a-928b-cedb4517a1b5 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 200 len: 1732 microversion: 2.20 time: 0.182467 Dec 15 16:29:31.299410 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 490/990] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:29:31 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 1732 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:29:32.321870 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-aef46bd3-8ebe-4d78-9289-b23f05a4002e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:32.322459 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-aef46bd3-8ebe-4d78-9289-b23f05a4002e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:32.330910 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-aef46bd3-8ebe-4d78-9289-b23f05a4002e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:32.331589 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-aef46bd3-8ebe-4d78-9289-b23f05a4002e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:32.332704 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-aef46bd3-8ebe-4d78-9289-b23f05a4002e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:32.333252 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-aef46bd3-8ebe-4d78-9289-b23f05a4002e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:32.477243 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-aef46bd3-8ebe-4d78-9289-b23f05a4002e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:32.485794 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-aef46bd3-8ebe-4d78-9289-b23f05a4002e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:32.487283 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-aef46bd3-8ebe-4d78-9289-b23f05a4002e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:32.488831 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-aef46bd3-8ebe-4d78-9289-b23f05a4002e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 200 len: 1732 microversion: 2.20 time: 0.172421 Dec 15 16:29:32.489398 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 501/991] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:29:32 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:29:33.507475 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-4417fce3-b1c8-4c2b-91b8-624e2573776b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:33.508403 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-4417fce3-b1c8-4c2b-91b8-624e2573776b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:33.515692 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4417fce3-b1c8-4c2b-91b8-624e2573776b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:33.516127 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4417fce3-b1c8-4c2b-91b8-624e2573776b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:33.516944 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4417fce3-b1c8-4c2b-91b8-624e2573776b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:33.517376 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4417fce3-b1c8-4c2b-91b8-624e2573776b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:33.664260 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-4417fce3-b1c8-4c2b-91b8-624e2573776b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:33.673912 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-4417fce3-b1c8-4c2b-91b8-624e2573776b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:33.675657 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-4417fce3-b1c8-4c2b-91b8-624e2573776b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:33.677212 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-4417fce3-b1c8-4c2b-91b8-624e2573776b tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 200 len: 1732 microversion: 2.20 time: 0.173383 Dec 15 16:29:33.677570 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 491/992] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:29:33 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 1732 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:29:34.705692 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-e4f374ff-17d4-40ae-b7af-5db822ae2f70 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:34.706324 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-e4f374ff-17d4-40ae-b7af-5db822ae2f70 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:34.713160 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e4f374ff-17d4-40ae-b7af-5db822ae2f70 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:34.713611 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e4f374ff-17d4-40ae-b7af-5db822ae2f70 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:34.714443 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e4f374ff-17d4-40ae-b7af-5db822ae2f70 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:34.714881 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-e4f374ff-17d4-40ae-b7af-5db822ae2f70 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:34.887335 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e4f374ff-17d4-40ae-b7af-5db822ae2f70 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:34.896390 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e4f374ff-17d4-40ae-b7af-5db822ae2f70 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:34.897858 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-e4f374ff-17d4-40ae-b7af-5db822ae2f70 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:34.899030 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-e4f374ff-17d4-40ae-b7af-5db822ae2f70 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 200 len: 1732 microversion: 2.20 time: 0.197537 Dec 15 16:29:34.899644 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 502/993] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:29:34 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 1732 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:29:35.283182 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-e86d7512-3cd2-4cd7-9911-a1df592ef917 req-67516f59-c118-440c-97e7-e80c3c858f04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfff70d8-7b03-417e-886b-1929e47645d5", "name": "network-vif-plugged", "status": "completed", "tag": "2e6e772a-f992-461a-881b-dffbf851deca"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:29:35.284842 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:29:35.284842 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Dec 15 16:29:35.292933 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-e86d7512-3cd2-4cd7-9911-a1df592ef917 req-67516f59-c118-440c-97e7-e80c3c858f04 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:35.293247 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-e86d7512-3cd2-4cd7-9911-a1df592ef917 req-67516f59-c118-440c-97e7-e80c3c858f04 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:35.310039 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-e86d7512-3cd2-4cd7-9911-a1df592ef917 req-67516f59-c118-440c-97e7-e80c3c858f04 service nova] Creating event network-vif-plugged:2e6e772a-f992-461a-881b-dffbf851deca for instance bfff70d8-7b03-417e-886b-1929e47645d5 on hv-cinder-81268 Dec 15 16:29:35.318548 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-e86d7512-3cd2-4cd7-9911-a1df592ef917 req-67516f59-c118-440c-97e7-e80c3c858f04 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040294 Dec 15 16:29:35.319166 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 492/994] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:29:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:29:35.917970 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-2597339b-3c65-4faa-ad97-2f4ebdbe52b8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:35.918549 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-2597339b-3c65-4faa-ad97-2f4ebdbe52b8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:35.925468 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2597339b-3c65-4faa-ad97-2f4ebdbe52b8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:35.925918 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2597339b-3c65-4faa-ad97-2f4ebdbe52b8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:35.926791 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2597339b-3c65-4faa-ad97-2f4ebdbe52b8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:35.927595 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2597339b-3c65-4faa-ad97-2f4ebdbe52b8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:36.071853 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-2597339b-3c65-4faa-ad97-2f4ebdbe52b8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:36.080708 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-2597339b-3c65-4faa-ad97-2f4ebdbe52b8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:36.082193 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-2597339b-3c65-4faa-ad97-2f4ebdbe52b8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:36.083349 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-2597339b-3c65-4faa-ad97-2f4ebdbe52b8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 200 len: 1732 microversion: 2.20 time: 0.169441 Dec 15 16:29:36.083931 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 503/995] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:29:35 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 1732 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:29:37.103200 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-a6c6c716-9342-4e21-b8ec-15383064fb91 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:37.104641 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-a6c6c716-9342-4e21-b8ec-15383064fb91 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:37.112389 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a6c6c716-9342-4e21-b8ec-15383064fb91 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:37.113198 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a6c6c716-9342-4e21-b8ec-15383064fb91 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:37.115177 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a6c6c716-9342-4e21-b8ec-15383064fb91 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:37.115868 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a6c6c716-9342-4e21-b8ec-15383064fb91 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:37.288994 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-a6c6c716-9342-4e21-b8ec-15383064fb91 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:37.297777 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-a6c6c716-9342-4e21-b8ec-15383064fb91 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:37.299293 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-a6c6c716-9342-4e21-b8ec-15383064fb91 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:37.300515 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-a6c6c716-9342-4e21-b8ec-15383064fb91 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 200 len: 1732 microversion: 2.20 time: 0.202166 Dec 15 16:29:37.301063 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 493/996] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:29:37 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 1732 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 15 16:29:38.322736 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-679e33d8-6419-495d-8d4a-f18b8e193498 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:38.324434 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-679e33d8-6419-495d-8d4a-f18b8e193498 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:38.338643 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-679e33d8-6419-495d-8d4a-f18b8e193498 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:38.339222 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-679e33d8-6419-495d-8d4a-f18b8e193498 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:38.340284 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-679e33d8-6419-495d-8d4a-f18b8e193498 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:38.340853 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-679e33d8-6419-495d-8d4a-f18b8e193498 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:38.495673 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-679e33d8-6419-495d-8d4a-f18b8e193498 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:38.504657 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-679e33d8-6419-495d-8d4a-f18b8e193498 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:38.506283 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-679e33d8-6419-495d-8d4a-f18b8e193498 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:38.507823 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-679e33d8-6419-495d-8d4a-f18b8e193498 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 200 len: 1719 microversion: 2.20 time: 0.192165 Dec 15 16:29:38.508405 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 504/997] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:29:38 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 1719 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:29:44.611409 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-391cef59-0328-4543-bf21-c0b4285e2f34 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1277597006", "imageRef": "b72b5f54-34d0-48ac-9484-bc8104a6dddb", "flavorRef": "452"}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:29:44.665799 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.network.neutron [None req-391cef59-0328-4543-bf21-c0b4285e2f34 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] validate_networks() for None {{(pid=116085) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:29:44.950505 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-391cef59-0328-4543-bf21-c0b4285e2f34 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Flavor limits 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:29:44.950971 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-391cef59-0328-4543-bf21-c0b4285e2f34 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Image limits 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:29:44.951461 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-391cef59-0328-4543-bf21-c0b4285e2f34 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Flavor pref 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:29:44.951873 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-391cef59-0328-4543-bf21-c0b4285e2f34 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Image pref 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:29:44.952282 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-391cef59-0328-4543-bf21-c0b4285e2f34 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:29:44.962882 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-391cef59-0328-4543-bf21-c0b4285e2f34 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:44.963323 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-391cef59-0328-4543-bf21-c0b4285e2f34 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:44.964181 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-391cef59-0328-4543-bf21-c0b4285e2f34 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:44.964622 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-391cef59-0328-4543-bf21-c0b4285e2f34 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:44.981052 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-391cef59-0328-4543-bf21-c0b4285e2f34 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Getting quotas for project 0df93c4ed9c64cfd98323d4296515310. Resources: {'cores', 'instances', 'ram'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:29:44.985049 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-391cef59-0328-4543-bf21-c0b4285e2f34 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Getting quotas for user fb21e168d1aa40efae89fe519ce76a58 and project 0df93c4ed9c64cfd98323d4296515310. Resources: {'cores', 'instances', 'ram'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:29:45.000026 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-391cef59-0328-4543-bf21-c0b4285e2f34 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Going to run 1 instances... {{(pid=116085) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:29:45.002920 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-391cef59-0328-4543-bf21-c0b4285e2f34 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] [instance: 9b6b5d4e-f923-4a46-9156-7f7a707ef5f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b72b5f54-34d0-48ac-9484-bc8104a6dddb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116085) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:29:45.051563 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-391cef59-0328-4543-bf21-c0b4285e2f34 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.446185 Dec 15 16:29:45.052234 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 494/998] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Dec 15 16:29:44 2021] POST /compute/v2.1/servers => generated 380 bytes in 448 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 16:29:45.062571 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-61b8ef22-de91-4f0b-a7bd-9b5754e3faab tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:45.063162 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-61b8ef22-de91-4f0b-a7bd-9b5754e3faab tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] [instance: 9b6b5d4e-f923-4a46-9156-7f7a707ef5f8] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:45.119265 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-61b8ef22-de91-4f0b-a7bd-9b5754e3faab tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb21e168d1aa40efae89fe519ce76a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df93c4ed9c64cfd98323d4296515310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:45.127016 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-61b8ef22-de91-4f0b-a7bd-9b5754e3faab tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] 10.222.0.60 "GET /compute/v2.1/servers/9b6b5d4e-f923-4a46-9156-7f7a707ef5f8" status: 200 len: 1215 microversion: 2.1 time: 0.067917 Dec 15 16:29:45.127654 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 505/999] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:45 2021] GET /compute/v2.1/servers/9b6b5d4e-f923-4a46-9156-7f7a707ef5f8 => generated 1215 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:46.144449 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-6c1ae36e-bb55-4885-8798-1ca072401f45 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:46.145725 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-6c1ae36e-bb55-4885-8798-1ca072401f45 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] [instance: 9b6b5d4e-f923-4a46-9156-7f7a707ef5f8] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:46.152314 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6c1ae36e-bb55-4885-8798-1ca072401f45 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:46.152787 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6c1ae36e-bb55-4885-8798-1ca072401f45 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:46.153565 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6c1ae36e-bb55-4885-8798-1ca072401f45 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:46.154015 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-6c1ae36e-bb55-4885-8798-1ca072401f45 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:46.216040 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-6c1ae36e-bb55-4885-8798-1ca072401f45 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb21e168d1aa40efae89fe519ce76a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df93c4ed9c64cfd98323d4296515310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:46.223547 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-6c1ae36e-bb55-4885-8798-1ca072401f45 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] 10.222.0.60 "GET /compute/v2.1/servers/9b6b5d4e-f923-4a46-9156-7f7a707ef5f8" status: 200 len: 1273 microversion: 2.1 time: 0.083302 Dec 15 16:29:46.224110 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 495/1000] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:46 2021] GET /compute/v2.1/servers/9b6b5d4e-f923-4a46-9156-7f7a707ef5f8 => generated 1273 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:47.241715 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-156135a3-2d2c-4169-9e5e-b2bb078e5a31 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:47.242683 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-156135a3-2d2c-4169-9e5e-b2bb078e5a31 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] [instance: 9b6b5d4e-f923-4a46-9156-7f7a707ef5f8] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:47.249834 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-156135a3-2d2c-4169-9e5e-b2bb078e5a31 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:47.250283 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-156135a3-2d2c-4169-9e5e-b2bb078e5a31 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:47.251049 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-156135a3-2d2c-4169-9e5e-b2bb078e5a31 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:47.251554 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-156135a3-2d2c-4169-9e5e-b2bb078e5a31 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:47.393406 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-156135a3-2d2c-4169-9e5e-b2bb078e5a31 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb21e168d1aa40efae89fe519ce76a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df93c4ed9c64cfd98323d4296515310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:47.403891 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-156135a3-2d2c-4169-9e5e-b2bb078e5a31 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] 10.222.0.60 "GET /compute/v2.1/servers/9b6b5d4e-f923-4a46-9156-7f7a707ef5f8" status: 200 len: 1315 microversion: 2.1 time: 0.166348 Dec 15 16:29:47.404974 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 506/1001] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:47 2021] GET /compute/v2.1/servers/9b6b5d4e-f923-4a46-9156-7f7a707ef5f8 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:47.600863 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-cc945654-9ce3-4641-bfbf-7abdb31a7b80 req-c04b451a-bfe2-4f6b-ad87-0977b621e86d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b6b5d4e-f923-4a46-9156-7f7a707ef5f8", "tag": "8758d99c-101e-4549-8e87-27eca41c9eff"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:29:47.603145 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:29:47.603145 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Dec 15 16:29:47.629720 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-cc945654-9ce3-4641-bfbf-7abdb31a7b80 req-c04b451a-bfe2-4f6b-ad87-0977b621e86d service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:47.632282 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-cc945654-9ce3-4641-bfbf-7abdb31a7b80 req-c04b451a-bfe2-4f6b-ad87-0977b621e86d service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:47.651012 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-cc945654-9ce3-4641-bfbf-7abdb31a7b80 req-c04b451a-bfe2-4f6b-ad87-0977b621e86d service nova] Creating event network-changed:8758d99c-101e-4549-8e87-27eca41c9eff for instance 9b6b5d4e-f923-4a46-9156-7f7a707ef5f8 on hv-cinder-81268 Dec 15 16:29:47.658482 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-cc945654-9ce3-4641-bfbf-7abdb31a7b80 req-c04b451a-bfe2-4f6b-ad87-0977b621e86d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061130 Dec 15 16:29:47.659725 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 496/1002] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:29:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:29:48.421241 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1ec06b28-f6b3-4152-b58a-28e87eab04f2 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:48.421888 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1ec06b28-f6b3-4152-b58a-28e87eab04f2 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] [instance: 9b6b5d4e-f923-4a46-9156-7f7a707ef5f8] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:48.429060 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1ec06b28-f6b3-4152-b58a-28e87eab04f2 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:48.429544 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1ec06b28-f6b3-4152-b58a-28e87eab04f2 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:48.430328 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1ec06b28-f6b3-4152-b58a-28e87eab04f2 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:48.430761 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1ec06b28-f6b3-4152-b58a-28e87eab04f2 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:48.565989 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1ec06b28-f6b3-4152-b58a-28e87eab04f2 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb21e168d1aa40efae89fe519ce76a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df93c4ed9c64cfd98323d4296515310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:48.574208 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1ec06b28-f6b3-4152-b58a-28e87eab04f2 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] 10.222.0.60 "GET /compute/v2.1/servers/9b6b5d4e-f923-4a46-9156-7f7a707ef5f8" status: 200 len: 1315 microversion: 2.1 time: 0.156577 Dec 15 16:29:48.574721 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 507/1003] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:48 2021] GET /compute/v2.1/servers/9b6b5d4e-f923-4a46-9156-7f7a707ef5f8 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:49.595391 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-05c5ad9a-8dd7-49a5-b08a-a6a81ec217f1 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:49.596045 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-05c5ad9a-8dd7-49a5-b08a-a6a81ec217f1 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] [instance: 9b6b5d4e-f923-4a46-9156-7f7a707ef5f8] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:49.603363 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-05c5ad9a-8dd7-49a5-b08a-a6a81ec217f1 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:49.603876 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-05c5ad9a-8dd7-49a5-b08a-a6a81ec217f1 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:49.604673 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-05c5ad9a-8dd7-49a5-b08a-a6a81ec217f1 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:49.605106 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-05c5ad9a-8dd7-49a5-b08a-a6a81ec217f1 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:49.771292 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-05c5ad9a-8dd7-49a5-b08a-a6a81ec217f1 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb21e168d1aa40efae89fe519ce76a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df93c4ed9c64cfd98323d4296515310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:49.779409 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-05c5ad9a-8dd7-49a5-b08a-a6a81ec217f1 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] 10.222.0.60 "GET /compute/v2.1/servers/9b6b5d4e-f923-4a46-9156-7f7a707ef5f8" status: 200 len: 1315 microversion: 2.1 time: 0.190750 Dec 15 16:29:49.780025 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 497/1004] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:49 2021] GET /compute/v2.1/servers/9b6b5d4e-f923-4a46-9156-7f7a707ef5f8 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:50.805677 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-2591bbe5-f5f5-4ffb-a384-163e4a89d350 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:50.806806 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-2591bbe5-f5f5-4ffb-a384-163e4a89d350 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] [instance: 9b6b5d4e-f923-4a46-9156-7f7a707ef5f8] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:50.817072 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2591bbe5-f5f5-4ffb-a384-163e4a89d350 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:50.817812 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2591bbe5-f5f5-4ffb-a384-163e4a89d350 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:50.819171 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2591bbe5-f5f5-4ffb-a384-163e4a89d350 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:50.820017 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-2591bbe5-f5f5-4ffb-a384-163e4a89d350 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:50.965602 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-2591bbe5-f5f5-4ffb-a384-163e4a89d350 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb21e168d1aa40efae89fe519ce76a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df93c4ed9c64cfd98323d4296515310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:50.976776 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-2591bbe5-f5f5-4ffb-a384-163e4a89d350 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] 10.222.0.60 "GET /compute/v2.1/servers/9b6b5d4e-f923-4a46-9156-7f7a707ef5f8" status: 200 len: 1315 microversion: 2.1 time: 0.177321 Dec 15 16:29:50.977740 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 508/1005] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:50 2021] GET /compute/v2.1/servers/9b6b5d4e-f923-4a46-9156-7f7a707ef5f8 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:51.995947 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-51c99cdc-6e94-4874-a623-0006f27b541f tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:51.996589 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-51c99cdc-6e94-4874-a623-0006f27b541f tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] [instance: 9b6b5d4e-f923-4a46-9156-7f7a707ef5f8] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:52.003504 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-51c99cdc-6e94-4874-a623-0006f27b541f tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:52.003955 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-51c99cdc-6e94-4874-a623-0006f27b541f tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:52.004752 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-51c99cdc-6e94-4874-a623-0006f27b541f tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:52.005166 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-51c99cdc-6e94-4874-a623-0006f27b541f tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:52.155837 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-51c99cdc-6e94-4874-a623-0006f27b541f tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb21e168d1aa40efae89fe519ce76a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df93c4ed9c64cfd98323d4296515310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:52.163273 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-51c99cdc-6e94-4874-a623-0006f27b541f tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] 10.222.0.60 "GET /compute/v2.1/servers/9b6b5d4e-f923-4a46-9156-7f7a707ef5f8" status: 200 len: 1315 microversion: 2.1 time: 0.172097 Dec 15 16:29:52.163835 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 498/1006] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:51 2021] GET /compute/v2.1/servers/9b6b5d4e-f923-4a46-9156-7f7a707ef5f8 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:53.180915 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-07b584b5-0812-428f-b252-f935ed68cdb1 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:53.181660 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-07b584b5-0812-428f-b252-f935ed68cdb1 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] [instance: 9b6b5d4e-f923-4a46-9156-7f7a707ef5f8] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:53.188642 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-07b584b5-0812-428f-b252-f935ed68cdb1 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:53.189094 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-07b584b5-0812-428f-b252-f935ed68cdb1 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:53.189889 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-07b584b5-0812-428f-b252-f935ed68cdb1 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:53.190328 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-07b584b5-0812-428f-b252-f935ed68cdb1 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:53.333342 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-07b584b5-0812-428f-b252-f935ed68cdb1 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb21e168d1aa40efae89fe519ce76a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df93c4ed9c64cfd98323d4296515310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:53.343384 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-07b584b5-0812-428f-b252-f935ed68cdb1 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] 10.222.0.60 "GET /compute/v2.1/servers/9b6b5d4e-f923-4a46-9156-7f7a707ef5f8" status: 200 len: 1315 microversion: 2.1 time: 0.166252 Dec 15 16:29:53.344002 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 509/1007] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:53 2021] GET /compute/v2.1/servers/9b6b5d4e-f923-4a46-9156-7f7a707ef5f8 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:53.352514 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-617b8098-aede-443f-9bc2-a8eecb09c6c5 req-1c853fa9-c748-47ec-b69e-8aae9c25cd3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b6b5d4e-f923-4a46-9156-7f7a707ef5f8", "name": "network-vif-plugged", "status": "completed", "tag": "8758d99c-101e-4549-8e87-27eca41c9eff"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:29:53.354907 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:29:53.354907 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Dec 15 16:29:53.362341 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-617b8098-aede-443f-9bc2-a8eecb09c6c5 req-1c853fa9-c748-47ec-b69e-8aae9c25cd3b service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:53.362961 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-617b8098-aede-443f-9bc2-a8eecb09c6c5 req-1c853fa9-c748-47ec-b69e-8aae9c25cd3b service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:53.375617 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-617b8098-aede-443f-9bc2-a8eecb09c6c5 req-1c853fa9-c748-47ec-b69e-8aae9c25cd3b service nova] Creating event network-vif-plugged:8758d99c-101e-4549-8e87-27eca41c9eff for instance 9b6b5d4e-f923-4a46-9156-7f7a707ef5f8 on hv-cinder-81268 Dec 15 16:29:53.380249 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-617b8098-aede-443f-9bc2-a8eecb09c6c5 req-1c853fa9-c748-47ec-b69e-8aae9c25cd3b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031405 Dec 15 16:29:53.380850 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 499/1008] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:29:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:29:54.360309 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c4e01283-8be5-4ed7-bd8d-bb4785ca4cb0 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:54.360914 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c4e01283-8be5-4ed7-bd8d-bb4785ca4cb0 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] [instance: 9b6b5d4e-f923-4a46-9156-7f7a707ef5f8] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:54.368024 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c4e01283-8be5-4ed7-bd8d-bb4785ca4cb0 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:54.368467 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c4e01283-8be5-4ed7-bd8d-bb4785ca4cb0 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:54.369344 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c4e01283-8be5-4ed7-bd8d-bb4785ca4cb0 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:54.369770 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c4e01283-8be5-4ed7-bd8d-bb4785ca4cb0 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:54.516523 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-c4e01283-8be5-4ed7-bd8d-bb4785ca4cb0 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb21e168d1aa40efae89fe519ce76a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df93c4ed9c64cfd98323d4296515310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:54.527102 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c4e01283-8be5-4ed7-bd8d-bb4785ca4cb0 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] 10.222.0.60 "GET /compute/v2.1/servers/9b6b5d4e-f923-4a46-9156-7f7a707ef5f8" status: 200 len: 1315 microversion: 2.1 time: 0.170212 Dec 15 16:29:54.527975 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 510/1009] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:54 2021] GET /compute/v2.1/servers/9b6b5d4e-f923-4a46-9156-7f7a707ef5f8 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:55.545847 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-b89d3d08-539e-4a1b-94cf-891f966d74ef tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:55.546506 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-b89d3d08-539e-4a1b-94cf-891f966d74ef tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] [instance: 9b6b5d4e-f923-4a46-9156-7f7a707ef5f8] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:55.553312 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b89d3d08-539e-4a1b-94cf-891f966d74ef tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:55.553757 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b89d3d08-539e-4a1b-94cf-891f966d74ef tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:55.554523 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b89d3d08-539e-4a1b-94cf-891f966d74ef tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:55.554947 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-b89d3d08-539e-4a1b-94cf-891f966d74ef tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:55.703597 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-b89d3d08-539e-4a1b-94cf-891f966d74ef tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb21e168d1aa40efae89fe519ce76a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df93c4ed9c64cfd98323d4296515310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:55.713356 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-b89d3d08-539e-4a1b-94cf-891f966d74ef tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] 10.222.0.60 "GET /compute/v2.1/servers/9b6b5d4e-f923-4a46-9156-7f7a707ef5f8" status: 200 len: 1465 microversion: 2.1 time: 0.172198 Dec 15 16:29:55.714052 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 500/1010] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:55 2021] GET /compute/v2.1/servers/9b6b5d4e-f923-4a46-9156-7f7a707ef5f8 => generated 1465 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:55.753919 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-82be6054-e8ad-412c-bfa8-e35f3bedacb8 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:55.754421 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-82be6054-e8ad-412c-bfa8-e35f3bedacb8 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] [instance: 9b6b5d4e-f923-4a46-9156-7f7a707ef5f8] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:55.764504 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-82be6054-e8ad-412c-bfa8-e35f3bedacb8 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:55.765128 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-82be6054-e8ad-412c-bfa8-e35f3bedacb8 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:55.766196 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-82be6054-e8ad-412c-bfa8-e35f3bedacb8 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:55.766852 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-82be6054-e8ad-412c-bfa8-e35f3bedacb8 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:55.805783 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-82be6054-e8ad-412c-bfa8-e35f3bedacb8 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] [instance: 9b6b5d4e-f923-4a46-9156-7f7a707ef5f8] Going to try to terminate instance {{(pid=116084) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:29:56.046023 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-82be6054-e8ad-412c-bfa8-e35f3bedacb8 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] 10.222.0.60 "DELETE /compute/v2.1/servers/9b6b5d4e-f923-4a46-9156-7f7a707ef5f8" status: 204 len: 0 microversion: 2.1 time: 0.298013 Dec 15 16:29:56.046883 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 511/1011] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Dec 15 16:29:55 2021] DELETE /compute/v2.1/servers/9b6b5d4e-f923-4a46-9156-7f7a707ef5f8 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:29:56.056229 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-92a42740-8442-465c-b0de-fb91ae12ef89 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:56.056831 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-92a42740-8442-465c-b0de-fb91ae12ef89 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] [instance: 9b6b5d4e-f923-4a46-9156-7f7a707ef5f8] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:56.063496 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-92a42740-8442-465c-b0de-fb91ae12ef89 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:56.063961 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-92a42740-8442-465c-b0de-fb91ae12ef89 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:56.064762 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-92a42740-8442-465c-b0de-fb91ae12ef89 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:56.065183 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-92a42740-8442-465c-b0de-fb91ae12ef89 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:56.205776 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-92a42740-8442-465c-b0de-fb91ae12ef89 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb21e168d1aa40efae89fe519ce76a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df93c4ed9c64cfd98323d4296515310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:56.213968 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-92a42740-8442-465c-b0de-fb91ae12ef89 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] 10.222.0.60 "GET /compute/v2.1/servers/9b6b5d4e-f923-4a46-9156-7f7a707ef5f8" status: 200 len: 1471 microversion: 2.1 time: 0.162424 Dec 15 16:29:56.214562 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 501/1012] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:56 2021] GET /compute/v2.1/servers/9b6b5d4e-f923-4a46-9156-7f7a707ef5f8 => generated 1471 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:57.239148 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ebb3740f-6d25-42ce-8456-b227997d9210 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:57.240368 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ebb3740f-6d25-42ce-8456-b227997d9210 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] [instance: 9b6b5d4e-f923-4a46-9156-7f7a707ef5f8] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:57.248689 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ebb3740f-6d25-42ce-8456-b227997d9210 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:57.249128 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ebb3740f-6d25-42ce-8456-b227997d9210 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:57.249917 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ebb3740f-6d25-42ce-8456-b227997d9210 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:57.250369 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ebb3740f-6d25-42ce-8456-b227997d9210 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:57.397757 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ebb3740f-6d25-42ce-8456-b227997d9210 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb21e168d1aa40efae89fe519ce76a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df93c4ed9c64cfd98323d4296515310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:57.408424 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ebb3740f-6d25-42ce-8456-b227997d9210 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] 10.222.0.60 "GET /compute/v2.1/servers/9b6b5d4e-f923-4a46-9156-7f7a707ef5f8" status: 200 len: 1471 microversion: 2.1 time: 0.175501 Dec 15 16:29:57.409199 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 512/1013] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:57 2021] GET /compute/v2.1/servers/9b6b5d4e-f923-4a46-9156-7f7a707ef5f8 => generated 1471 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:58.017215 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-0036d2cd-b803-4e88-b6e2-bb3cb5db0d5d req-7d72207b-8ffc-4708-9b0b-990f20830123 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b6b5d4e-f923-4a46-9156-7f7a707ef5f8", "name": "network-vif-deleted", "tag": "8758d99c-101e-4549-8e87-27eca41c9eff"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:29:58.018871 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:29:58.018871 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Dec 15 16:29:58.026675 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-0036d2cd-b803-4e88-b6e2-bb3cb5db0d5d req-7d72207b-8ffc-4708-9b0b-990f20830123 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:58.027241 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-0036d2cd-b803-4e88-b6e2-bb3cb5db0d5d req-7d72207b-8ffc-4708-9b0b-990f20830123 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:58.040057 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-0036d2cd-b803-4e88-b6e2-bb3cb5db0d5d req-7d72207b-8ffc-4708-9b0b-990f20830123 service nova] Creating event network-vif-deleted:8758d99c-101e-4549-8e87-27eca41c9eff for instance 9b6b5d4e-f923-4a46-9156-7f7a707ef5f8 on hv-cinder-81268 Dec 15 16:29:58.045278 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-0036d2cd-b803-4e88-b6e2-bb3cb5db0d5d req-7d72207b-8ffc-4708-9b0b-990f20830123 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031636 Dec 15 16:29:58.045930 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 502/1014] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:29:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:29:58.428534 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-bb61d4ea-a07f-4960-b3c4-478ed7ac3f64 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:58.429220 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-bb61d4ea-a07f-4960-b3c4-478ed7ac3f64 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] [instance: 9b6b5d4e-f923-4a46-9156-7f7a707ef5f8] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:58.436940 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bb61d4ea-a07f-4960-b3c4-478ed7ac3f64 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:58.437599 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bb61d4ea-a07f-4960-b3c4-478ed7ac3f64 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:58.438397 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bb61d4ea-a07f-4960-b3c4-478ed7ac3f64 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:58.438876 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bb61d4ea-a07f-4960-b3c4-478ed7ac3f64 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:58.482472 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bb61d4ea-a07f-4960-b3c4-478ed7ac3f64 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:58.483057 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-bb61d4ea-a07f-4960-b3c4-478ed7ac3f64 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:58.483689 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.objects.instance [None req-bb61d4ea-a07f-4960-b3c4-478ed7ac3f64 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lazy-loading 'fault' on Instance uuid 9b6b5d4e-f923-4a46-9156-7f7a707ef5f8 {{(pid=116084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:29:58.527637 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-bb61d4ea-a07f-4960-b3c4-478ed7ac3f64 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb21e168d1aa40efae89fe519ce76a58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df93c4ed9c64cfd98323d4296515310', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:29:58.535292 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-bb61d4ea-a07f-4960-b3c4-478ed7ac3f64 tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] 10.222.0.60 "GET /compute/v2.1/servers/9b6b5d4e-f923-4a46-9156-7f7a707ef5f8" status: 200 len: 1305 microversion: 2.1 time: 0.110383 Dec 15 16:29:58.543226 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 513/1015] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:58 2021] GET /compute/v2.1/servers/9b6b5d4e-f923-4a46-9156-7f7a707ef5f8 => generated 1305 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:29:59.554406 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-498a1b5a-6811-49ca-92e4-ef67dc75150c tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:29:59.555059 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-498a1b5a-6811-49ca-92e4-ef67dc75150c tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] [instance: 9b6b5d4e-f923-4a46-9156-7f7a707ef5f8] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:29:59.562105 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-498a1b5a-6811-49ca-92e4-ef67dc75150c tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:59.562554 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-498a1b5a-6811-49ca-92e4-ef67dc75150c tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:59.563342 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-498a1b5a-6811-49ca-92e4-ef67dc75150c tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:29:59.563808 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-498a1b5a-6811-49ca-92e4-ef67dc75150c tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:29:59.577669 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.wsgi [None req-498a1b5a-6811-49ca-92e4-ef67dc75150c tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] HTTP exception thrown: Instance 9b6b5d4e-f923-4a46-9156-7f7a707ef5f8 could not be found. Dec 15 16:29:59.578185 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-498a1b5a-6811-49ca-92e4-ef67dc75150c tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] Returning 404 to user: Instance 9b6b5d4e-f923-4a46-9156-7f7a707ef5f8 could not be found. {{(pid=116085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:29:59.579010 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-498a1b5a-6811-49ca-92e4-ef67dc75150c tempest-VolumesNegativeTest-464744969 tempest-VolumesNegativeTest-464744969-project] 10.222.0.60 "GET /compute/v2.1/servers/9b6b5d4e-f923-4a46-9156-7f7a707ef5f8" status: 404 len: 111 microversion: 2.1 time: 0.029249 Dec 15 16:29:59.579585 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 503/1016] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:29:59 2021] GET /compute/v2.1/servers/9b6b5d4e-f923-4a46-9156-7f7a707ef5f8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:30:11.246084 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1dea28b6-50c0-4df1-8576-bf9ff58ea9f6 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:11.246977 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1dea28b6-50c0-4df1-8576-bf9ff58ea9f6 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:11.253771 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1dea28b6-50c0-4df1-8576-bf9ff58ea9f6 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:11.254227 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1dea28b6-50c0-4df1-8576-bf9ff58ea9f6 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:11.255034 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1dea28b6-50c0-4df1-8576-bf9ff58ea9f6 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:11.255509 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1dea28b6-50c0-4df1-8576-bf9ff58ea9f6 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:11.286462 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1dea28b6-50c0-4df1-8576-bf9ff58ea9f6 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044324 Dec 15 16:30:11.287008 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 514/1017] 10.222.0.60 () {60 vars in 1342 bytes} [Wed Dec 15 16:30:11 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:30:11.355144 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-fb89625d-d1ba-4df6-b281-8661fad5036e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:11.355925 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-fb89625d-d1ba-4df6-b281-8661fad5036e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:11.366233 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fb89625d-d1ba-4df6-b281-8661fad5036e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:11.366829 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fb89625d-d1ba-4df6-b281-8661fad5036e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:11.368041 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fb89625d-d1ba-4df6-b281-8661fad5036e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:11.368473 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-fb89625d-d1ba-4df6-b281-8661fad5036e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:11.396890 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-fb89625d-d1ba-4df6-b281-8661fad5036e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Going to try to terminate instance {{(pid=116085) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:30:11.475739 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-fb89625d-d1ba-4df6-b281-8661fad5036e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "DELETE /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 204 len: 0 microversion: 2.20 time: 0.126191 Dec 15 16:30:11.476342 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 504/1018] 10.222.0.60 () {60 vars in 1279 bytes} [Wed Dec 15 16:30:11 2021] DELETE /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 15 16:30:11.485472 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b6a81465-8993-46b8-bfd6-4273cf5e7141 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:11.486032 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b6a81465-8993-46b8-bfd6-4273cf5e7141 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:11.492585 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b6a81465-8993-46b8-bfd6-4273cf5e7141 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:11.493029 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b6a81465-8993-46b8-bfd6-4273cf5e7141 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:11.493820 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b6a81465-8993-46b8-bfd6-4273cf5e7141 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:11.494252 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b6a81465-8993-46b8-bfd6-4273cf5e7141 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:11.639989 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b6a81465-8993-46b8-bfd6-4273cf5e7141 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:30:11.648886 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b6a81465-8993-46b8-bfd6-4273cf5e7141 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:30:11.650815 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b6a81465-8993-46b8-bfd6-4273cf5e7141 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:30:11.652688 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b6a81465-8993-46b8-bfd6-4273cf5e7141 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 200 len: 1725 microversion: 2.20 time: 0.170857 Dec 15 16:30:11.653614 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 515/1019] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:30:11 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:30:12.682183 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-153438de-18b4-4cd2-a0d6-73c00560d2b7 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:12.682878 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-153438de-18b4-4cd2-a0d6-73c00560d2b7 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:12.690047 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-153438de-18b4-4cd2-a0d6-73c00560d2b7 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:12.690490 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-153438de-18b4-4cd2-a0d6-73c00560d2b7 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:12.691316 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-153438de-18b4-4cd2-a0d6-73c00560d2b7 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:12.691833 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-153438de-18b4-4cd2-a0d6-73c00560d2b7 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:12.840744 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-153438de-18b4-4cd2-a0d6-73c00560d2b7 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:30:12.849352 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-153438de-18b4-4cd2-a0d6-73c00560d2b7 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:30:12.850839 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-153438de-18b4-4cd2-a0d6-73c00560d2b7 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:30:12.852019 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-153438de-18b4-4cd2-a0d6-73c00560d2b7 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 200 len: 1725 microversion: 2.20 time: 0.174067 Dec 15 16:30:12.852574 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 505/1020] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:30:12 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:30:13.744356 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-5310729e-8e47-4f83-a7bf-37c0f0e96df9 req-21d5e43b-4206-45f2-af0a-61428716a94c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfff70d8-7b03-417e-886b-1929e47645d5", "name": "network-vif-deleted", "tag": "2e6e772a-f992-461a-881b-dffbf851deca"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:30:13.746070 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:30:13.746070 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:30:13.753874 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-5310729e-8e47-4f83-a7bf-37c0f0e96df9 req-21d5e43b-4206-45f2-af0a-61428716a94c service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:13.754524 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-5310729e-8e47-4f83-a7bf-37c0f0e96df9 req-21d5e43b-4206-45f2-af0a-61428716a94c service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:13.779835 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-5310729e-8e47-4f83-a7bf-37c0f0e96df9 req-21d5e43b-4206-45f2-af0a-61428716a94c service nova] Creating event network-vif-deleted:2e6e772a-f992-461a-881b-dffbf851deca for instance bfff70d8-7b03-417e-886b-1929e47645d5 on hv-cinder-81268 Dec 15 16:30:13.786224 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-5310729e-8e47-4f83-a7bf-37c0f0e96df9 req-21d5e43b-4206-45f2-af0a-61428716a94c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045672 Dec 15 16:30:13.787119 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 516/1021] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:30:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:30:13.873312 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-9305e777-100b-4675-9edb-53607ca6c7ca tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:13.874221 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-9305e777-100b-4675-9edb-53607ca6c7ca tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:13.881500 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9305e777-100b-4675-9edb-53607ca6c7ca tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:13.881953 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9305e777-100b-4675-9edb-53607ca6c7ca tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:13.883658 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9305e777-100b-4675-9edb-53607ca6c7ca tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:13.884113 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9305e777-100b-4675-9edb-53607ca6c7ca tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:13.926250 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9305e777-100b-4675-9edb-53607ca6c7ca tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:13.926694 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9305e777-100b-4675-9edb-53607ca6c7ca tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:13.927163 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.objects.instance [None req-9305e777-100b-4675-9edb-53607ca6c7ca tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lazy-loading 'fault' on Instance uuid bfff70d8-7b03-417e-886b-1929e47645d5 {{(pid=116085) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:30:13.971192 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-9305e777-100b-4675-9edb-53607ca6c7ca tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:30:13.979817 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-9305e777-100b-4675-9edb-53607ca6c7ca tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:30:13.981396 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-9305e777-100b-4675-9edb-53607ca6c7ca tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a7cfeb030104d338be8575f10d8ec68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6fd27025742699d14dbf14680c7c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:30:13.982549 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-9305e777-100b-4675-9edb-53607ca6c7ca tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 200 len: 1372 microversion: 2.20 time: 0.114210 Dec 15 16:30:13.983350 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 506/1022] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:30:13 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 1372 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 15 16:30:15.004330 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-a0714a06-bbf3-4408-a24e-c42f510ac055 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:15.005114 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-a0714a06-bbf3-4408-a24e-c42f510ac055 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:15.012209 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a0714a06-bbf3-4408-a24e-c42f510ac055 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:15.012666 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a0714a06-bbf3-4408-a24e-c42f510ac055 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:15.013470 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a0714a06-bbf3-4408-a24e-c42f510ac055 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:15.013909 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a0714a06-bbf3-4408-a24e-c42f510ac055 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:15.027529 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-a0714a06-bbf3-4408-a24e-c42f510ac055 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] HTTP exception thrown: Instance bfff70d8-7b03-417e-886b-1929e47645d5 could not be found. Dec 15 16:30:15.028144 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-a0714a06-bbf3-4408-a24e-c42f510ac055 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Returning 404 to user: Instance bfff70d8-7b03-417e-886b-1929e47645d5 could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:30:15.029002 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-a0714a06-bbf3-4408-a24e-c42f510ac055 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 404 len: 111 microversion: 2.20 time: 0.030889 Dec 15 16:30:15.029541 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 517/1023] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:30:14 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 16:30:15.038315 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-12f6d4a5-6919-4d19-bb84-59274da02bb8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '.version_select at 0x7f0b26964310>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:15.061388 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-12f6d4a5-6919-4d19-bb84-59274da02bb8 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1916099149" status: 204 len: 0 microversion: 2.20 time: 0.026953 Dec 15 16:30:15.061988 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 507/1024] 10.222.0.60 () {60 vars in 1261 bytes} [Wed Dec 15 16:30:15 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1916099149 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 15 16:30:16.885721 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0f161504-aa04-47d0-a656-01323f5ed0ab tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:16.886222 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-0f161504-aa04-47d0-a656-01323f5ed0ab tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:16.892977 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0f161504-aa04-47d0-a656-01323f5ed0ab tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:16.893799 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0f161504-aa04-47d0-a656-01323f5ed0ab tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:16.894568 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0f161504-aa04-47d0-a656-01323f5ed0ab tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:16.894987 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-0f161504-aa04-47d0-a656-01323f5ed0ab tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:16.908466 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-0f161504-aa04-47d0-a656-01323f5ed0ab tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] HTTP exception thrown: Instance bfff70d8-7b03-417e-886b-1929e47645d5 could not be found. Dec 15 16:30:16.909289 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-0f161504-aa04-47d0-a656-01323f5ed0ab tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Returning 404 to user: Instance bfff70d8-7b03-417e-886b-1929e47645d5 could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:30:16.910107 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-0f161504-aa04-47d0-a656-01323f5ed0ab tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "DELETE /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 404 len: 111 microversion: 2.20 time: 0.028285 Dec 15 16:30:16.910634 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 518/1025] 10.222.0.60 () {60 vars in 1279 bytes} [Wed Dec 15 16:30:16 2021] DELETE /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 16:30:16.919234 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-48bcbfe8-6797-4196-9f31-d5e6e08c5be3 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:16.919924 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-48bcbfe8-6797-4196-9f31-d5e6e08c5be3 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: bfff70d8-7b03-417e-886b-1929e47645d5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:16.927015 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-48bcbfe8-6797-4196-9f31-d5e6e08c5be3 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:16.927498 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-48bcbfe8-6797-4196-9f31-d5e6e08c5be3 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:16.928269 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-48bcbfe8-6797-4196-9f31-d5e6e08c5be3 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:16.928697 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-48bcbfe8-6797-4196-9f31-d5e6e08c5be3 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:16.943517 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.wsgi [None req-48bcbfe8-6797-4196-9f31-d5e6e08c5be3 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] HTTP exception thrown: Instance bfff70d8-7b03-417e-886b-1929e47645d5 could not be found. Dec 15 16:30:16.944105 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-48bcbfe8-6797-4196-9f31-d5e6e08c5be3 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Returning 404 to user: Instance bfff70d8-7b03-417e-886b-1929e47645d5 could not be found. {{(pid=116085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:30:16.944918 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-48bcbfe8-6797-4196-9f31-d5e6e08c5be3 tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5" status: 404 len: 111 microversion: 2.20 time: 0.029974 Dec 15 16:30:16.945438 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 508/1026] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:30:16 2021] GET /compute/v2.1/servers/bfff70d8-7b03-417e-886b-1929e47645d5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 16:30:18.100754 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-9072f6c4-e076-48d8-b286-15de7eb1d74e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:18.101299 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-9072f6c4-e076-48d8-b286-15de7eb1d74e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:18.108196 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9072f6c4-e076-48d8-b286-15de7eb1d74e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:18.108648 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9072f6c4-e076-48d8-b286-15de7eb1d74e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:18.109229 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9072f6c4-e076-48d8-b286-15de7eb1d74e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:18.109662 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-9072f6c4-e076-48d8-b286-15de7eb1d74e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:18.125604 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-9072f6c4-e076-48d8-b286-15de7eb1d74e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] HTTP exception thrown: Instance 049761b5-88eb-4325-af0e-03da2842cbf5 could not be found. Dec 15 16:30:18.126208 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-9072f6c4-e076-48d8-b286-15de7eb1d74e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Returning 404 to user: Instance 049761b5-88eb-4325-af0e-03da2842cbf5 could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:30:18.127041 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-9072f6c4-e076-48d8-b286-15de7eb1d74e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "DELETE /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 404 len: 111 microversion: 2.20 time: 0.030462 Dec 15 16:30:18.127611 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 519/1027] 10.222.0.60 () {60 vars in 1279 bytes} [Wed Dec 15 16:30:18 2021] DELETE /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 16:30:18.136627 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-41c7877b-d867-4bfd-8086-3b8e98e7a29e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:30:18.137256 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-41c7877b-d867-4bfd-8086-3b8e98e7a29e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] [instance: 049761b5-88eb-4325-af0e-03da2842cbf5] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:30:18.144139 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-41c7877b-d867-4bfd-8086-3b8e98e7a29e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:18.144592 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-41c7877b-d867-4bfd-8086-3b8e98e7a29e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:18.145366 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-41c7877b-d867-4bfd-8086-3b8e98e7a29e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:30:18.145776 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-41c7877b-d867-4bfd-8086-3b8e98e7a29e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:30:18.321630 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.wsgi [None req-41c7877b-d867-4bfd-8086-3b8e98e7a29e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] HTTP exception thrown: Instance 049761b5-88eb-4325-af0e-03da2842cbf5 could not be found. Dec 15 16:30:18.322238 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-41c7877b-d867-4bfd-8086-3b8e98e7a29e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] Returning 404 to user: Instance 049761b5-88eb-4325-af0e-03da2842cbf5 could not be found. {{(pid=116085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:30:18.323274 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-41c7877b-d867-4bfd-8086-3b8e98e7a29e tempest-AttachVolumeShelveTestJSON-797092756 tempest-AttachVolumeShelveTestJSON-797092756-project] 10.222.0.60 "GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5" status: 404 len: 111 microversion: 2.20 time: 0.190285 Dec 15 16:30:18.323654 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 509/1028] 10.222.0.60 () {60 vars in 1276 bytes} [Wed Dec 15 16:30:18 2021] GET /compute/v2.1/servers/049761b5-88eb-4325-af0e-03da2842cbf5 => generated 111 bytes in 191 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 15 16:31:10.224115 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-082bd0ec-320f-4a14-a968-bccee0197053 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Action: 'create', calling method: .version_select at 0x7f0b26a091f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2107665422"}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:31:10.238132 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-082bd0ec-320f-4a14-a968-bccee0197053 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Getting quotas for project ab2d1be987d44e91a0bfaaaf47b3235f. Resources: {'key_pairs'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:31:10.242018 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-082bd0ec-320f-4a14-a968-bccee0197053 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Getting quotas for user 88a345b057104e559c3a3e8826cf10a1 and project ab2d1be987d44e91a0bfaaaf47b3235f. Resources: {'key_pairs'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:31:10.329857 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-082bd0ec-320f-4a14-a968-bccee0197053 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Getting quotas for project ab2d1be987d44e91a0bfaaaf47b3235f. Resources: {'key_pairs'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:31:10.333835 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.quota [None req-082bd0ec-320f-4a14-a968-bccee0197053 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Getting quotas for user 88a345b057104e559c3a3e8826cf10a1 and project ab2d1be987d44e91a0bfaaaf47b3235f. Resources: {'key_pairs'} {{(pid=116084) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:31:10.347838 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-082bd0ec-320f-4a14-a968-bccee0197053 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.127568 Dec 15 16:31:10.348648 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 520/1029] 10.222.0.60 () {60 vars in 1157 bytes} [Wed Dec 15 16:31:10 2021] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:10.399537 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-079d42eb-02ef-4b47-9539-0fa640fdb7dd tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-412836580", "imageRef": "7b8c0758-25aa-4b3e-acb7-ef599246b785", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2107665422", "networks": [{"uuid": "944a922e-526f-48e8-8eb2-1c3a749cb11e"}]}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:31:10.574829 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.network.neutron [None req-079d42eb-02ef-4b47-9539-0fa640fdb7dd tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] validate_networks() for [('944a922e-526f-48e8-8eb2-1c3a749cb11e', None, None, None, None, None)] {{(pid=116085) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 15 16:31:11.115739 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-079d42eb-02ef-4b47-9539-0fa640fdb7dd tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Flavor limits 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 15 16:31:11.116343 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-079d42eb-02ef-4b47-9539-0fa640fdb7dd tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Image limits 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 15 16:31:11.117105 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-079d42eb-02ef-4b47-9539-0fa640fdb7dd tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Flavor pref 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 15 16:31:11.117697 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-079d42eb-02ef-4b47-9539-0fa640fdb7dd tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Image pref 0:0:0 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 15 16:31:11.118570 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.virt.hardware [None req-079d42eb-02ef-4b47-9539-0fa640fdb7dd tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 15 16:31:11.135805 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-079d42eb-02ef-4b47-9539-0fa640fdb7dd tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:11.136514 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-079d42eb-02ef-4b47-9539-0fa640fdb7dd tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:11.137837 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-079d42eb-02ef-4b47-9539-0fa640fdb7dd tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:11.138592 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-079d42eb-02ef-4b47-9539-0fa640fdb7dd tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:11.156142 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-079d42eb-02ef-4b47-9539-0fa640fdb7dd tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Getting quotas for project ab2d1be987d44e91a0bfaaaf47b3235f. Resources: {'cores', 'instances', 'ram'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 15 16:31:11.160673 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.quota [None req-079d42eb-02ef-4b47-9539-0fa640fdb7dd tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Getting quotas for user 88a345b057104e559c3a3e8826cf10a1 and project ab2d1be987d44e91a0bfaaaf47b3235f. Resources: {'cores', 'instances', 'ram'} {{(pid=116085) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 15 16:31:11.172174 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-079d42eb-02ef-4b47-9539-0fa640fdb7dd tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Going to run 1 instances... {{(pid=116085) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 15 16:31:11.174437 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-079d42eb-02ef-4b47-9539-0fa640fdb7dd tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] [instance: a11a4277-5614-4ba2-8452-4d7a8739292c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7b8c0758-25aa-4b3e-acb7-ef599246b785',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116085) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 15 16:31:11.225064 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-079d42eb-02ef-4b47-9539-0fa640fdb7dd tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.831579 Dec 15 16:31:11.225752 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 510/1030] 10.222.0.60 () {60 vars in 1146 bytes} [Wed Dec 15 16:31:10 2021] POST /compute/v2.1/servers => generated 380 bytes in 833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 15 16:31:11.236776 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c91acbb0-08e0-4c87-8149-6101cfb6be6f tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:11.237418 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c91acbb0-08e0-4c87-8149-6101cfb6be6f tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] [instance: a11a4277-5614-4ba2-8452-4d7a8739292c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:11.351285 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-c91acbb0-08e0-4c87-8149-6101cfb6be6f tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a345b057104e559c3a3e8826cf10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2d1be987d44e91a0bfaaaf47b3235f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:11.358860 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c91acbb0-08e0-4c87-8149-6101cfb6be6f tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] 10.222.0.60 "GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c" status: 200 len: 1258 microversion: 2.1 time: 0.126386 Dec 15 16:31:11.359388 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 521/1031] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:11 2021] GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c => generated 1258 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:12.380442 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-983b5301-1ccf-430e-9ac0-6c929f5478e5 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:12.381481 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-983b5301-1ccf-430e-9ac0-6c929f5478e5 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] [instance: a11a4277-5614-4ba2-8452-4d7a8739292c] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:12.390865 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-983b5301-1ccf-430e-9ac0-6c929f5478e5 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:12.391302 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-983b5301-1ccf-430e-9ac0-6c929f5478e5 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:12.392141 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-983b5301-1ccf-430e-9ac0-6c929f5478e5 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:12.392571 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-983b5301-1ccf-430e-9ac0-6c929f5478e5 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:12.455143 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-983b5301-1ccf-430e-9ac0-6c929f5478e5 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a345b057104e559c3a3e8826cf10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2d1be987d44e91a0bfaaaf47b3235f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:12.462953 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-983b5301-1ccf-430e-9ac0-6c929f5478e5 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] 10.222.0.60 "GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c" status: 200 len: 1328 microversion: 2.1 time: 0.089133 Dec 15 16:31:12.472957 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 511/1032] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:12 2021] GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c => generated 1328 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:13.480902 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-4da478f7-4779-4f10-8ccc-b280596c9df1 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:13.481495 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-4da478f7-4779-4f10-8ccc-b280596c9df1 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] [instance: a11a4277-5614-4ba2-8452-4d7a8739292c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:13.488438 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4da478f7-4779-4f10-8ccc-b280596c9df1 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:13.488886 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4da478f7-4779-4f10-8ccc-b280596c9df1 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:13.489702 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4da478f7-4779-4f10-8ccc-b280596c9df1 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:13.490133 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-4da478f7-4779-4f10-8ccc-b280596c9df1 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:13.667001 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-4da478f7-4779-4f10-8ccc-b280596c9df1 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a345b057104e559c3a3e8826cf10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2d1be987d44e91a0bfaaaf47b3235f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:13.676466 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-4da478f7-4779-4f10-8ccc-b280596c9df1 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] 10.222.0.60 "GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c" status: 200 len: 1358 microversion: 2.1 time: 0.199275 Dec 15 16:31:13.677868 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 522/1033] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:13 2021] GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:14.697309 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-3fced538-0cb6-4102-a7bf-97df42c7efef tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:14.697914 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-3fced538-0cb6-4102-a7bf-97df42c7efef tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] [instance: a11a4277-5614-4ba2-8452-4d7a8739292c] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:14.705137 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3fced538-0cb6-4102-a7bf-97df42c7efef tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:14.705592 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3fced538-0cb6-4102-a7bf-97df42c7efef tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:14.706388 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3fced538-0cb6-4102-a7bf-97df42c7efef tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:14.706826 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-3fced538-0cb6-4102-a7bf-97df42c7efef tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:14.872742 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-3fced538-0cb6-4102-a7bf-97df42c7efef tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a345b057104e559c3a3e8826cf10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2d1be987d44e91a0bfaaaf47b3235f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:14.880541 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-3fced538-0cb6-4102-a7bf-97df42c7efef tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] 10.222.0.60 "GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c" status: 200 len: 1358 microversion: 2.1 time: 0.186984 Dec 15 16:31:14.881239 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 512/1034] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:14 2021] GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:15.900151 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-7dbac06d-f149-4b33-92a3-6074f91e9053 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:15.900762 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-7dbac06d-f149-4b33-92a3-6074f91e9053 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] [instance: a11a4277-5614-4ba2-8452-4d7a8739292c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:15.908745 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7dbac06d-f149-4b33-92a3-6074f91e9053 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:15.909189 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7dbac06d-f149-4b33-92a3-6074f91e9053 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:15.910107 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7dbac06d-f149-4b33-92a3-6074f91e9053 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:15.910555 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7dbac06d-f149-4b33-92a3-6074f91e9053 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:16.079817 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-7dbac06d-f149-4b33-92a3-6074f91e9053 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a345b057104e559c3a3e8826cf10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2d1be987d44e91a0bfaaaf47b3235f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:16.087395 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-7dbac06d-f149-4b33-92a3-6074f91e9053 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] 10.222.0.60 "GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c" status: 200 len: 1358 microversion: 2.1 time: 0.191756 Dec 15 16:31:16.087972 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 523/1035] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:15 2021] GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:17.104252 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-c4b7eb55-1146-48c2-9ab3-651b59a08f79 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:17.104885 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-c4b7eb55-1146-48c2-9ab3-651b59a08f79 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] [instance: a11a4277-5614-4ba2-8452-4d7a8739292c] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:17.112745 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c4b7eb55-1146-48c2-9ab3-651b59a08f79 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:17.113192 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c4b7eb55-1146-48c2-9ab3-651b59a08f79 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:17.113979 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c4b7eb55-1146-48c2-9ab3-651b59a08f79 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:17.114413 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-c4b7eb55-1146-48c2-9ab3-651b59a08f79 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:17.254180 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-c4b7eb55-1146-48c2-9ab3-651b59a08f79 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a345b057104e559c3a3e8826cf10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2d1be987d44e91a0bfaaaf47b3235f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:17.269908 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-c4b7eb55-1146-48c2-9ab3-651b59a08f79 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] 10.222.0.60 "GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c" status: 200 len: 1358 microversion: 2.1 time: 0.169246 Dec 15 16:31:17.271132 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 513/1036] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:17 2021] GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:18.290175 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-b958f25f-9cab-4755-82e0-c46d12306dab tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:18.291580 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-b958f25f-9cab-4755-82e0-c46d12306dab tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] [instance: a11a4277-5614-4ba2-8452-4d7a8739292c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:18.303611 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b958f25f-9cab-4755-82e0-c46d12306dab tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:18.304491 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b958f25f-9cab-4755-82e0-c46d12306dab tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:18.306192 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b958f25f-9cab-4755-82e0-c46d12306dab tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:18.307028 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-b958f25f-9cab-4755-82e0-c46d12306dab tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:18.446627 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-b958f25f-9cab-4755-82e0-c46d12306dab tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a345b057104e559c3a3e8826cf10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2d1be987d44e91a0bfaaaf47b3235f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:18.454245 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-b958f25f-9cab-4755-82e0-c46d12306dab tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] 10.222.0.60 "GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c" status: 200 len: 1358 microversion: 2.1 time: 0.171123 Dec 15 16:31:18.454816 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 524/1037] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:18 2021] GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:19.472348 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-9dde1564-fefd-4989-a7ee-887973ad9d49 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:19.472985 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-9dde1564-fefd-4989-a7ee-887973ad9d49 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] [instance: a11a4277-5614-4ba2-8452-4d7a8739292c] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:19.480362 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9dde1564-fefd-4989-a7ee-887973ad9d49 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:19.480937 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9dde1564-fefd-4989-a7ee-887973ad9d49 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:19.481898 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9dde1564-fefd-4989-a7ee-887973ad9d49 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:19.482504 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-9dde1564-fefd-4989-a7ee-887973ad9d49 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:19.645248 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-9dde1564-fefd-4989-a7ee-887973ad9d49 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a345b057104e559c3a3e8826cf10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2d1be987d44e91a0bfaaaf47b3235f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:19.652977 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-9dde1564-fefd-4989-a7ee-887973ad9d49 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] 10.222.0.60 "GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c" status: 200 len: 1358 microversion: 2.1 time: 0.184598 Dec 15 16:31:19.655931 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 514/1038] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:19 2021] GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:20.670538 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-cc03947a-6625-4acb-a9fa-8c79f821d9f6 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:20.671254 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-cc03947a-6625-4acb-a9fa-8c79f821d9f6 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] [instance: a11a4277-5614-4ba2-8452-4d7a8739292c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:20.678067 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cc03947a-6625-4acb-a9fa-8c79f821d9f6 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:20.678637 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cc03947a-6625-4acb-a9fa-8c79f821d9f6 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:20.679648 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cc03947a-6625-4acb-a9fa-8c79f821d9f6 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:20.680126 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-cc03947a-6625-4acb-a9fa-8c79f821d9f6 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:20.841770 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-cc03947a-6625-4acb-a9fa-8c79f821d9f6 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a345b057104e559c3a3e8826cf10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2d1be987d44e91a0bfaaaf47b3235f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:20.850426 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-cc03947a-6625-4acb-a9fa-8c79f821d9f6 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] 10.222.0.60 "GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c" status: 200 len: 1358 microversion: 2.1 time: 0.183704 Dec 15 16:31:20.850995 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 525/1039] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:20 2021] GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:21.869324 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-78885e8e-8ad1-4d09-ae17-5916c2fa04c2 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:21.869975 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-78885e8e-8ad1-4d09-ae17-5916c2fa04c2 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] [instance: a11a4277-5614-4ba2-8452-4d7a8739292c] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:21.876409 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-78885e8e-8ad1-4d09-ae17-5916c2fa04c2 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:21.877214 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-78885e8e-8ad1-4d09-ae17-5916c2fa04c2 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:21.878019 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-78885e8e-8ad1-4d09-ae17-5916c2fa04c2 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:21.878700 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-78885e8e-8ad1-4d09-ae17-5916c2fa04c2 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:22.022039 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-78885e8e-8ad1-4d09-ae17-5916c2fa04c2 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a345b057104e559c3a3e8826cf10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2d1be987d44e91a0bfaaaf47b3235f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:22.032281 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-78885e8e-8ad1-4d09-ae17-5916c2fa04c2 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] 10.222.0.60 "GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c" status: 200 len: 1358 microversion: 2.1 time: 0.167608 Dec 15 16:31:22.032840 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 515/1040] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:21 2021] GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:23.050184 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-de324b26-c6c4-49eb-9c3b-c2526cfbac9c tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:23.051042 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-de324b26-c6c4-49eb-9c3b-c2526cfbac9c tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] [instance: a11a4277-5614-4ba2-8452-4d7a8739292c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:23.057994 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-de324b26-c6c4-49eb-9c3b-c2526cfbac9c tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:23.058447 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-de324b26-c6c4-49eb-9c3b-c2526cfbac9c tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:23.059256 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-de324b26-c6c4-49eb-9c3b-c2526cfbac9c tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:23.059726 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-de324b26-c6c4-49eb-9c3b-c2526cfbac9c tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:23.205723 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-de324b26-c6c4-49eb-9c3b-c2526cfbac9c tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a345b057104e559c3a3e8826cf10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2d1be987d44e91a0bfaaaf47b3235f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:23.214501 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-de324b26-c6c4-49eb-9c3b-c2526cfbac9c tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] 10.222.0.60 "GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c" status: 200 len: 1358 microversion: 2.1 time: 0.168559 Dec 15 16:31:23.215099 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 526/1041] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:23 2021] GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:24.232442 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-5f220565-4a49-43b8-a788-6397817473bf tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:24.233114 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-5f220565-4a49-43b8-a788-6397817473bf tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] [instance: a11a4277-5614-4ba2-8452-4d7a8739292c] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:24.246729 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5f220565-4a49-43b8-a788-6397817473bf tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:24.247266 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5f220565-4a49-43b8-a788-6397817473bf tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:24.247964 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5f220565-4a49-43b8-a788-6397817473bf tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:24.248424 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-5f220565-4a49-43b8-a788-6397817473bf tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:24.399247 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-5f220565-4a49-43b8-a788-6397817473bf tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a345b057104e559c3a3e8826cf10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2d1be987d44e91a0bfaaaf47b3235f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:24.406820 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-5f220565-4a49-43b8-a788-6397817473bf tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] 10.222.0.60 "GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c" status: 200 len: 1358 microversion: 2.1 time: 0.178424 Dec 15 16:31:24.407392 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 516/1042] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:24 2021] GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:25.424977 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-a83ef30a-2ae0-412a-a78b-93af4d966e1d tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:25.425803 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-a83ef30a-2ae0-412a-a78b-93af4d966e1d tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] [instance: a11a4277-5614-4ba2-8452-4d7a8739292c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:25.432911 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a83ef30a-2ae0-412a-a78b-93af4d966e1d tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:25.433206 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a83ef30a-2ae0-412a-a78b-93af4d966e1d tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:25.434037 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a83ef30a-2ae0-412a-a78b-93af4d966e1d tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:25.434436 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a83ef30a-2ae0-412a-a78b-93af4d966e1d tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:25.577785 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-a83ef30a-2ae0-412a-a78b-93af4d966e1d tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a345b057104e559c3a3e8826cf10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2d1be987d44e91a0bfaaaf47b3235f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:25.586236 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-a83ef30a-2ae0-412a-a78b-93af4d966e1d tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] 10.222.0.60 "GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c" status: 200 len: 1358 microversion: 2.1 time: 0.164972 Dec 15 16:31:25.586801 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 527/1043] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:25 2021] GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:25.675574 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-40c08119-be0f-4353-b143-9768e22511c8 req-24b11079-06a4-4fe7-9738-8d208d3d2e22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a11a4277-5614-4ba2-8452-4d7a8739292c", "tag": "69178240-43dc-4650-a6a4-f74c6c15626c"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:31:25.677984 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:31:25.677984 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Dec 15 16:31:25.686724 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-40c08119-be0f-4353-b143-9768e22511c8 req-24b11079-06a4-4fe7-9738-8d208d3d2e22 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:25.687719 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-40c08119-be0f-4353-b143-9768e22511c8 req-24b11079-06a4-4fe7-9738-8d208d3d2e22 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:25.702065 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-40c08119-be0f-4353-b143-9768e22511c8 req-24b11079-06a4-4fe7-9738-8d208d3d2e22 service nova] Creating event network-changed:69178240-43dc-4650-a6a4-f74c6c15626c for instance a11a4277-5614-4ba2-8452-4d7a8739292c on hv-cinder-81268 Dec 15 16:31:25.708398 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-40c08119-be0f-4353-b143-9768e22511c8 req-24b11079-06a4-4fe7-9738-8d208d3d2e22 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036289 Dec 15 16:31:25.709766 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 517/1044] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:31:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:31:26.603403 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-7caf50fe-c7ba-42da-980c-a197991ad3cf tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:26.604087 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-7caf50fe-c7ba-42da-980c-a197991ad3cf tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] [instance: a11a4277-5614-4ba2-8452-4d7a8739292c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:26.610939 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7caf50fe-c7ba-42da-980c-a197991ad3cf tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:26.611396 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7caf50fe-c7ba-42da-980c-a197991ad3cf tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:26.612203 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7caf50fe-c7ba-42da-980c-a197991ad3cf tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:26.612846 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7caf50fe-c7ba-42da-980c-a197991ad3cf tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:26.756548 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-7caf50fe-c7ba-42da-980c-a197991ad3cf tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a345b057104e559c3a3e8826cf10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2d1be987d44e91a0bfaaaf47b3235f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:26.764674 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-7caf50fe-c7ba-42da-980c-a197991ad3cf tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] 10.222.0.60 "GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c" status: 200 len: 1358 microversion: 2.1 time: 0.165072 Dec 15 16:31:26.765235 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 528/1045] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:26 2021] GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:27.783418 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-1bff04dd-8774-41b6-9ac2-a56bf3f7e821 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:27.784025 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-1bff04dd-8774-41b6-9ac2-a56bf3f7e821 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] [instance: a11a4277-5614-4ba2-8452-4d7a8739292c] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:27.791133 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1bff04dd-8774-41b6-9ac2-a56bf3f7e821 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:27.791607 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1bff04dd-8774-41b6-9ac2-a56bf3f7e821 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:27.792406 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1bff04dd-8774-41b6-9ac2-a56bf3f7e821 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:27.792838 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1bff04dd-8774-41b6-9ac2-a56bf3f7e821 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:27.952568 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-1bff04dd-8774-41b6-9ac2-a56bf3f7e821 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a345b057104e559c3a3e8826cf10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2d1be987d44e91a0bfaaaf47b3235f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:27.960615 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-1bff04dd-8774-41b6-9ac2-a56bf3f7e821 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] 10.222.0.60 "GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c" status: 200 len: 1358 microversion: 2.1 time: 0.181924 Dec 15 16:31:27.961173 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 518/1046] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:27 2021] GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:28.980981 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-8ee6a8a7-631f-419c-8e84-0d43296ba84c tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:28.981967 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-8ee6a8a7-631f-419c-8e84-0d43296ba84c tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] [instance: a11a4277-5614-4ba2-8452-4d7a8739292c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:28.991602 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8ee6a8a7-631f-419c-8e84-0d43296ba84c tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:28.992051 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8ee6a8a7-631f-419c-8e84-0d43296ba84c tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:28.992835 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8ee6a8a7-631f-419c-8e84-0d43296ba84c tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:28.993261 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8ee6a8a7-631f-419c-8e84-0d43296ba84c tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:29.133077 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-8ee6a8a7-631f-419c-8e84-0d43296ba84c tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a345b057104e559c3a3e8826cf10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2d1be987d44e91a0bfaaaf47b3235f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:29.144674 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-8ee6a8a7-631f-419c-8e84-0d43296ba84c tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] 10.222.0.60 "GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c" status: 200 len: 1358 microversion: 2.1 time: 0.169307 Dec 15 16:31:29.145410 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 529/1047] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:28 2021] GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:30.162740 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-0784c4d6-abf9-4e69-b10e-e0e90e596271 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:30.163499 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-0784c4d6-abf9-4e69-b10e-e0e90e596271 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] [instance: a11a4277-5614-4ba2-8452-4d7a8739292c] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:30.172431 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0784c4d6-abf9-4e69-b10e-e0e90e596271 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:30.172905 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0784c4d6-abf9-4e69-b10e-e0e90e596271 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:30.173688 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0784c4d6-abf9-4e69-b10e-e0e90e596271 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:30.174124 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0784c4d6-abf9-4e69-b10e-e0e90e596271 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:30.319675 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-0784c4d6-abf9-4e69-b10e-e0e90e596271 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a345b057104e559c3a3e8826cf10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2d1be987d44e91a0bfaaaf47b3235f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:30.329448 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-0784c4d6-abf9-4e69-b10e-e0e90e596271 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] 10.222.0.60 "GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c" status: 200 len: 1358 microversion: 2.1 time: 0.170683 Dec 15 16:31:30.330255 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 519/1048] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:30 2021] GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:31.347258 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c0b012bf-f127-4eed-bb82-ff296063c4cc tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:31.347906 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c0b012bf-f127-4eed-bb82-ff296063c4cc tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] [instance: a11a4277-5614-4ba2-8452-4d7a8739292c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:31.355021 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c0b012bf-f127-4eed-bb82-ff296063c4cc tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:31.355505 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c0b012bf-f127-4eed-bb82-ff296063c4cc tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:31.356386 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c0b012bf-f127-4eed-bb82-ff296063c4cc tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:31.356806 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c0b012bf-f127-4eed-bb82-ff296063c4cc tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:31.498961 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-c0b012bf-f127-4eed-bb82-ff296063c4cc tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a345b057104e559c3a3e8826cf10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2d1be987d44e91a0bfaaaf47b3235f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:31.507662 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c0b012bf-f127-4eed-bb82-ff296063c4cc tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] 10.222.0.60 "GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c" status: 200 len: 1358 microversion: 2.1 time: 0.164082 Dec 15 16:31:31.507931 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 530/1049] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:31 2021] GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:31.785981 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-64a00658-889b-4588-a15c-65c717b11d64 req-2e8e28e0-02e6-4814-8497-f111f6502e10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a11a4277-5614-4ba2-8452-4d7a8739292c", "name": "network-vif-plugged", "status": "completed", "tag": "69178240-43dc-4650-a6a4-f74c6c15626c"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:31:31.787813 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:31:31.787813 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Dec 15 16:31:31.797902 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-64a00658-889b-4588-a15c-65c717b11d64 req-2e8e28e0-02e6-4814-8497-f111f6502e10 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:31.798357 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-64a00658-889b-4588-a15c-65c717b11d64 req-2e8e28e0-02e6-4814-8497-f111f6502e10 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:31.810898 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-64a00658-889b-4588-a15c-65c717b11d64 req-2e8e28e0-02e6-4814-8497-f111f6502e10 service nova] Creating event network-vif-plugged:69178240-43dc-4650-a6a4-f74c6c15626c for instance a11a4277-5614-4ba2-8452-4d7a8739292c on hv-cinder-81268 Dec 15 16:31:31.816059 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-64a00658-889b-4588-a15c-65c717b11d64 req-2e8e28e0-02e6-4814-8497-f111f6502e10 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033814 Dec 15 16:31:31.816643 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 520/1050] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:31:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:31:32.528390 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c7bcd463-8ba2-44fa-9a79-ccc775397cc2 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:32.529235 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c7bcd463-8ba2-44fa-9a79-ccc775397cc2 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] [instance: a11a4277-5614-4ba2-8452-4d7a8739292c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:32.538892 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c7bcd463-8ba2-44fa-9a79-ccc775397cc2 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:32.539618 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c7bcd463-8ba2-44fa-9a79-ccc775397cc2 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:32.540745 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c7bcd463-8ba2-44fa-9a79-ccc775397cc2 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:32.541407 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c7bcd463-8ba2-44fa-9a79-ccc775397cc2 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:32.687540 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-c7bcd463-8ba2-44fa-9a79-ccc775397cc2 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a345b057104e559c3a3e8826cf10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2d1be987d44e91a0bfaaaf47b3235f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:32.695355 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c7bcd463-8ba2-44fa-9a79-ccc775397cc2 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] 10.222.0.60 "GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c" status: 200 len: 1358 microversion: 2.1 time: 0.173287 Dec 15 16:31:32.695958 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 531/1051] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:32 2021] GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:33.713987 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-d70e1daa-bafd-4bc0-9180-84ab22f66551 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:33.714596 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-d70e1daa-bafd-4bc0-9180-84ab22f66551 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] [instance: a11a4277-5614-4ba2-8452-4d7a8739292c] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:33.724025 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d70e1daa-bafd-4bc0-9180-84ab22f66551 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:33.724655 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d70e1daa-bafd-4bc0-9180-84ab22f66551 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:33.725795 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d70e1daa-bafd-4bc0-9180-84ab22f66551 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:33.726234 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-d70e1daa-bafd-4bc0-9180-84ab22f66551 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:33.861506 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-d70e1daa-bafd-4bc0-9180-84ab22f66551 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a345b057104e559c3a3e8826cf10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2d1be987d44e91a0bfaaaf47b3235f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:33.874891 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-d70e1daa-bafd-4bc0-9180-84ab22f66551 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] 10.222.0.60 "GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c" status: 200 len: 1547 microversion: 2.1 time: 0.165249 Dec 15 16:31:33.875825 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 521/1052] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:33 2021] GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c => generated 1547 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:33.894074 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d5add49f-e2ac-435c-a617-1660a8242235 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:33.894657 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d5add49f-e2ac-435c-a617-1660a8242235 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] [instance: a11a4277-5614-4ba2-8452-4d7a8739292c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:33.902231 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d5add49f-e2ac-435c-a617-1660a8242235 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:33.902972 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d5add49f-e2ac-435c-a617-1660a8242235 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:33.903816 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d5add49f-e2ac-435c-a617-1660a8242235 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:33.904232 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d5add49f-e2ac-435c-a617-1660a8242235 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:34.064126 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d5add49f-e2ac-435c-a617-1660a8242235 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a345b057104e559c3a3e8826cf10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2d1be987d44e91a0bfaaaf47b3235f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:34.074333 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d5add49f-e2ac-435c-a617-1660a8242235 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] 10.222.0.60 "GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c" status: 200 len: 1547 microversion: 2.1 time: 0.183823 Dec 15 16:31:34.075094 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 532/1053] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:33 2021] GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c => generated 1547 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:34.090598 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-aa5d737c-83b4-49f5-9e70-dc1725a2ed2e tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:34.093953 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:31:34.093953 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Dec 15 16:31:34.094936 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-aa5d737c-83b4-49f5-9e70-dc1725a2ed2e tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '88a345b057104e559c3a3e8826cf10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2d1be987d44e91a0bfaaaf47b3235f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:34.095814 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-aa5d737c-83b4-49f5-9e70-dc1725a2ed2e tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Searching by: {'deleted': False, 'project_id': 'ab2d1be987d44e91a0bfaaaf47b3235f'} {{(pid=116085) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 15 16:31:34.103189 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-aa5d737c-83b4-49f5-9e70-dc1725a2ed2e tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:34.103671 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-aa5d737c-83b4-49f5-9e70-dc1725a2ed2e tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:34.104449 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-aa5d737c-83b4-49f5-9e70-dc1725a2ed2e tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:34.104902 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-aa5d737c-83b4-49f5-9e70-dc1725a2ed2e tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:34.203194 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.multi_cell_list [None req-aa5d737c-83b4-49f5-9e70-dc1725a2ed2e tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116085) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 15 16:31:34.295828 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-aa5d737c-83b4-49f5-9e70-dc1725a2ed2e tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.208752 Dec 15 16:31:34.296407 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 522/1054] 10.222.0.60 () {58 vars in 1124 bytes} [Wed Dec 15 16:31:34 2021] GET /compute/v2.1/servers => generated 342 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:31:34.306744 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-a6cc1f37-1329-425a-b4b8-68b1df79ddb7 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:34.307394 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-a6cc1f37-1329-425a-b4b8-68b1df79ddb7 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] [instance: a11a4277-5614-4ba2-8452-4d7a8739292c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:34.313935 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a6cc1f37-1329-425a-b4b8-68b1df79ddb7 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:34.314363 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a6cc1f37-1329-425a-b4b8-68b1df79ddb7 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:34.315138 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a6cc1f37-1329-425a-b4b8-68b1df79ddb7 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:34.315630 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-a6cc1f37-1329-425a-b4b8-68b1df79ddb7 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:34.457199 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-a6cc1f37-1329-425a-b4b8-68b1df79ddb7 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a345b057104e559c3a3e8826cf10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2d1be987d44e91a0bfaaaf47b3235f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:34.468726 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-a6cc1f37-1329-425a-b4b8-68b1df79ddb7 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] 10.222.0.60 "GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c" status: 200 len: 1547 microversion: 2.1 time: 0.165487 Dec 15 16:31:34.469676 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 533/1055] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:34 2021] GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c => generated 1547 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:36.028970 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-1860883d-15d2-4dd4-a6d1-7d21e755a5cb tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cd9667c7-32fa-4446-9342-3a5ffb640994"}} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:31:36.030656 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-1860883d-15d2-4dd4-a6d1-7d21e755a5cb tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] [instance: a11a4277-5614-4ba2-8452-4d7a8739292c] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:36.040254 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1860883d-15d2-4dd4-a6d1-7d21e755a5cb tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:36.040704 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1860883d-15d2-4dd4-a6d1-7d21e755a5cb tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:36.041489 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1860883d-15d2-4dd4-a6d1-7d21e755a5cb tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:36.041925 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1860883d-15d2-4dd4-a6d1-7d21e755a5cb tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:36.319212 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-1860883d-15d2-4dd4-a6d1-7d21e755a5cb tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] 10.222.0.60 "POST /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296097 Dec 15 16:31:36.319895 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 523/1056] 10.222.0.60 () {60 vars in 1322 bytes} [Wed Dec 15 16:31:36 2021] POST /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:31:42.840953 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-d3a14d78-04ae-4db9-bfbe-2e70b4619180 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:42.841578 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-d3a14d78-04ae-4db9-bfbe-2e70b4619180 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] [instance: a11a4277-5614-4ba2-8452-4d7a8739292c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:42.848634 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d3a14d78-04ae-4db9-bfbe-2e70b4619180 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:42.849087 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d3a14d78-04ae-4db9-bfbe-2e70b4619180 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:42.849869 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d3a14d78-04ae-4db9-bfbe-2e70b4619180 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:42.850309 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-d3a14d78-04ae-4db9-bfbe-2e70b4619180 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:42.993697 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-d3a14d78-04ae-4db9-bfbe-2e70b4619180 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a345b057104e559c3a3e8826cf10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2d1be987d44e91a0bfaaaf47b3235f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:43.002465 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-d3a14d78-04ae-4db9-bfbe-2e70b4619180 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] 10.222.0.60 "GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c" status: 200 len: 1593 microversion: 2.1 time: 0.165241 Dec 15 16:31:43.003040 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 534/1057] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:42 2021] GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c => generated 1593 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:31:44.845498 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-cfe0cc26-2966-4f45-97d6-1e3bb88d494c req-7c9470d1-47f9-4bee-8cb2-3120879e5f46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a11a4277-5614-4ba2-8452-4d7a8739292c", "tag": "69178240-43dc-4650-a6a4-f74c6c15626c"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:31:44.847090 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:31:44.847090 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Dec 15 16:31:44.855227 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-cfe0cc26-2966-4f45-97d6-1e3bb88d494c req-7c9470d1-47f9-4bee-8cb2-3120879e5f46 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:44.855745 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-cfe0cc26-2966-4f45-97d6-1e3bb88d494c req-7c9470d1-47f9-4bee-8cb2-3120879e5f46 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:44.867629 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-cfe0cc26-2966-4f45-97d6-1e3bb88d494c req-7c9470d1-47f9-4bee-8cb2-3120879e5f46 service nova] Creating event network-changed:69178240-43dc-4650-a6a4-f74c6c15626c for instance a11a4277-5614-4ba2-8452-4d7a8739292c on hv-cinder-81268 Dec 15 16:31:44.873562 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-cfe0cc26-2966-4f45-97d6-1e3bb88d494c req-7c9470d1-47f9-4bee-8cb2-3120879e5f46 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104460 Dec 15 16:31:44.874219 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 524/1058] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:31:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:31:45.774794 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c7545a4d-555b-4ba2-95a6-251ca9bed84c tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1763272433"}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:31:45.775394 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c7545a4d-555b-4ba2-95a6-251ca9bed84c tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] [instance: a11a4277-5614-4ba2-8452-4d7a8739292c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:45.781978 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c7545a4d-555b-4ba2-95a6-251ca9bed84c tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:45.782570 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c7545a4d-555b-4ba2-95a6-251ca9bed84c tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:45.783329 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c7545a4d-555b-4ba2-95a6-251ca9bed84c tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:45.783676 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c7545a4d-555b-4ba2-95a6-251ca9bed84c tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:45.920237 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.network.security_group_api [None req-c7545a4d-555b-4ba2-95a6-251ca9bed84c tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Adding security group 53f853d4-c2ca-4af6-a5d5-9043fd6a5869 to port 69178240-43dc-4650-a6a4-f74c6c15626c Dec 15 16:31:46.341170 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c7545a4d-555b-4ba2-95a6-251ca9bed84c tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] 10.222.0.60 "POST /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c/action" status: 202 len: 0 microversion: 2.1 time: 0.570358 Dec 15 16:31:46.341749 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 535/1059] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:31:45 2021] POST /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c/action => generated 0 bytes in 572 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:31:46.350944 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-cf39d426-0e89-4490-9d26-fec85b952d11 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:31:46.351680 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-cf39d426-0e89-4490-9d26-fec85b952d11 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] [instance: a11a4277-5614-4ba2-8452-4d7a8739292c] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:31:46.356777 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-1eccb3a2-021b-4faa-9773-9e0fb669c855 req-6dfa82c4-e455-4d57-a177-d4c63df46d62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a11a4277-5614-4ba2-8452-4d7a8739292c", "tag": "69178240-43dc-4650-a6a4-f74c6c15626c"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:31:46.358793 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:31:46.358793 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:31:46.359567 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-cf39d426-0e89-4490-9d26-fec85b952d11 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:46.360027 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-cf39d426-0e89-4490-9d26-fec85b952d11 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:46.360822 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-cf39d426-0e89-4490-9d26-fec85b952d11 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:46.361259 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-cf39d426-0e89-4490-9d26-fec85b952d11 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:46.368459 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-1eccb3a2-021b-4faa-9773-9e0fb669c855 req-6dfa82c4-e455-4d57-a177-d4c63df46d62 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:31:46.369082 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-1eccb3a2-021b-4faa-9773-9e0fb669c855 req-6dfa82c4-e455-4d57-a177-d4c63df46d62 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:31:46.392364 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-1eccb3a2-021b-4faa-9773-9e0fb669c855 req-6dfa82c4-e455-4d57-a177-d4c63df46d62 service nova] Creating event network-changed:69178240-43dc-4650-a6a4-f74c6c15626c for instance a11a4277-5614-4ba2-8452-4d7a8739292c on hv-cinder-81268 Dec 15 16:31:46.398978 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-1eccb3a2-021b-4faa-9773-9e0fb669c855 req-6dfa82c4-e455-4d57-a177-d4c63df46d62 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047379 Dec 15 16:31:46.400090 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 536/1060] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:31:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:31:46.553104 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-cf39d426-0e89-4490-9d26-fec85b952d11 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a345b057104e559c3a3e8826cf10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2d1be987d44e91a0bfaaaf47b3235f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:31:46.565593 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-cf39d426-0e89-4490-9d26-fec85b952d11 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] 10.222.0.60 "GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c" status: 200 len: 1759 microversion: 2.1 time: 0.218614 Dec 15 16:31:46.566346 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 525/1061] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:31:46 2021] GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c => generated 1759 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:32:09.171971 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-c45ad810-ebda-47a4-82de-acbd6b98553c tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:32:09.172996 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-c45ad810-ebda-47a4-82de-acbd6b98553c tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] [instance: a11a4277-5614-4ba2-8452-4d7a8739292c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:32:09.179749 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c45ad810-ebda-47a4-82de-acbd6b98553c tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:09.180194 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c45ad810-ebda-47a4-82de-acbd6b98553c tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:09.180967 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c45ad810-ebda-47a4-82de-acbd6b98553c tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:09.181397 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-c45ad810-ebda-47a4-82de-acbd6b98553c tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:09.262892 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-c45ad810-ebda-47a4-82de-acbd6b98553c tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] 10.222.0.60 "POST /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c/action" status: 202 len: 0 microversion: 2.1 time: 0.095895 Dec 15 16:32:09.263640 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 537/1062] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:32:09 2021] POST /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:32:09.273069 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-ac8ae0ac-46f2-462d-85b2-9d3351d8e364 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:32:09.273689 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-ac8ae0ac-46f2-462d-85b2-9d3351d8e364 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] [instance: a11a4277-5614-4ba2-8452-4d7a8739292c] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:32:09.280812 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ac8ae0ac-46f2-462d-85b2-9d3351d8e364 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:09.281353 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ac8ae0ac-46f2-462d-85b2-9d3351d8e364 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:09.282252 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ac8ae0ac-46f2-462d-85b2-9d3351d8e364 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:09.282848 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-ac8ae0ac-46f2-462d-85b2-9d3351d8e364 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:09.436015 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-ac8ae0ac-46f2-462d-85b2-9d3351d8e364 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a345b057104e559c3a3e8826cf10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2d1be987d44e91a0bfaaaf47b3235f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:32:09.444617 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-ac8ae0ac-46f2-462d-85b2-9d3351d8e364 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] 10.222.0.60 "GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c" status: 200 len: 1751 microversion: 2.1 time: 0.175615 Dec 15 16:32:09.445408 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 526/1063] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:32:09 2021] GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c => generated 1751 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:32:10.464427 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1a1d5b95-7cc3-40e9-a622-90f16da7f965 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:32:10.465120 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1a1d5b95-7cc3-40e9-a622-90f16da7f965 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] [instance: a11a4277-5614-4ba2-8452-4d7a8739292c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:32:10.473241 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1a1d5b95-7cc3-40e9-a622-90f16da7f965 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:10.473698 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1a1d5b95-7cc3-40e9-a622-90f16da7f965 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:10.474487 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1a1d5b95-7cc3-40e9-a622-90f16da7f965 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:10.474935 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1a1d5b95-7cc3-40e9-a622-90f16da7f965 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:10.639186 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1a1d5b95-7cc3-40e9-a622-90f16da7f965 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a345b057104e559c3a3e8826cf10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2d1be987d44e91a0bfaaaf47b3235f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:32:10.651203 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1a1d5b95-7cc3-40e9-a622-90f16da7f965 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] 10.222.0.60 "GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c" status: 200 len: 1756 microversion: 2.1 time: 0.191658 Dec 15 16:32:10.651943 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 538/1064] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:32:10 2021] GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c => generated 1756 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:32:11.669357 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-dad130e6-336b-44e0-9870-d2af7cef913e tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:32:11.669931 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-dad130e6-336b-44e0-9870-d2af7cef913e tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] [instance: a11a4277-5614-4ba2-8452-4d7a8739292c] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:32:11.676913 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-dad130e6-336b-44e0-9870-d2af7cef913e tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:11.677362 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-dad130e6-336b-44e0-9870-d2af7cef913e tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:11.678158 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-dad130e6-336b-44e0-9870-d2af7cef913e tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:11.678592 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-dad130e6-336b-44e0-9870-d2af7cef913e tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:11.839611 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-dad130e6-336b-44e0-9870-d2af7cef913e tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a345b057104e559c3a3e8826cf10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2d1be987d44e91a0bfaaaf47b3235f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:32:11.848189 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-dad130e6-336b-44e0-9870-d2af7cef913e tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] 10.222.0.60 "GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c" status: 200 len: 1756 microversion: 2.1 time: 0.182711 Dec 15 16:32:11.848762 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 527/1065] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:32:11 2021] GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c => generated 1756 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:32:12.873984 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-7996bc42-bca9-4fc4-af33-ae50a7952990 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:32:12.874599 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-7996bc42-bca9-4fc4-af33-ae50a7952990 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] [instance: a11a4277-5614-4ba2-8452-4d7a8739292c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:32:12.882745 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7996bc42-bca9-4fc4-af33-ae50a7952990 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:12.883204 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7996bc42-bca9-4fc4-af33-ae50a7952990 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:12.883997 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7996bc42-bca9-4fc4-af33-ae50a7952990 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:12.884476 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7996bc42-bca9-4fc4-af33-ae50a7952990 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:13.044780 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-7996bc42-bca9-4fc4-af33-ae50a7952990 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a345b057104e559c3a3e8826cf10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2d1be987d44e91a0bfaaaf47b3235f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:32:13.056652 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-7996bc42-bca9-4fc4-af33-ae50a7952990 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] 10.222.0.60 "GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c" status: 200 len: 1756 microversion: 2.1 time: 0.188663 Dec 15 16:32:13.057461 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 539/1066] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:32:12 2021] GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c => generated 1756 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:32:14.077909 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-7470c3d2-e8bd-4e1f-8154-d435de982884 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:32:14.077909 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-7470c3d2-e8bd-4e1f-8154-d435de982884 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] [instance: a11a4277-5614-4ba2-8452-4d7a8739292c] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:32:14.085787 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7470c3d2-e8bd-4e1f-8154-d435de982884 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:14.086442 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7470c3d2-e8bd-4e1f-8154-d435de982884 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:14.087234 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7470c3d2-e8bd-4e1f-8154-d435de982884 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:14.087704 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-7470c3d2-e8bd-4e1f-8154-d435de982884 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:14.238039 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-7470c3d2-e8bd-4e1f-8154-d435de982884 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a345b057104e559c3a3e8826cf10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2d1be987d44e91a0bfaaaf47b3235f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:32:14.247022 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-7470c3d2-e8bd-4e1f-8154-d435de982884 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] 10.222.0.60 "GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c" status: 200 len: 1756 microversion: 2.1 time: 0.173450 Dec 15 16:32:14.247651 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 528/1067] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:32:14 2021] GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:32:15.268627 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-3762f859-614b-445c-b5db-90ae144cadcc tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:32:15.269496 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-3762f859-614b-445c-b5db-90ae144cadcc tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] [instance: a11a4277-5614-4ba2-8452-4d7a8739292c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:32:15.278693 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3762f859-614b-445c-b5db-90ae144cadcc tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:15.279165 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3762f859-614b-445c-b5db-90ae144cadcc tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:15.280300 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3762f859-614b-445c-b5db-90ae144cadcc tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:15.280887 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3762f859-614b-445c-b5db-90ae144cadcc tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:15.441724 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-3762f859-614b-445c-b5db-90ae144cadcc tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a345b057104e559c3a3e8826cf10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2d1be987d44e91a0bfaaaf47b3235f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:32:15.453386 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-3762f859-614b-445c-b5db-90ae144cadcc tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] 10.222.0.60 "GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c" status: 200 len: 1756 microversion: 2.1 time: 0.190160 Dec 15 16:32:15.454119 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 540/1068] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:32:15 2021] GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c => generated 1756 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:32:16.471562 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-287e9f49-a736-449f-9340-62098d7f8385 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:32:16.472167 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-287e9f49-a736-449f-9340-62098d7f8385 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] [instance: a11a4277-5614-4ba2-8452-4d7a8739292c] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:32:16.479562 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-287e9f49-a736-449f-9340-62098d7f8385 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:16.480016 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-287e9f49-a736-449f-9340-62098d7f8385 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:16.480800 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-287e9f49-a736-449f-9340-62098d7f8385 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:16.481235 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-287e9f49-a736-449f-9340-62098d7f8385 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:16.638894 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-287e9f49-a736-449f-9340-62098d7f8385 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a345b057104e559c3a3e8826cf10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2d1be987d44e91a0bfaaaf47b3235f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:32:16.648983 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-287e9f49-a736-449f-9340-62098d7f8385 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] 10.222.0.60 "GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c" status: 200 len: 1756 microversion: 2.1 time: 0.181247 Dec 15 16:32:16.649551 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 529/1069] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:32:16 2021] GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:32:17.668930 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-84516a86-f69f-46ad-af03-dc309ff445cf tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:32:17.669614 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-84516a86-f69f-46ad-af03-dc309ff445cf tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] [instance: a11a4277-5614-4ba2-8452-4d7a8739292c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:32:17.677801 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-84516a86-f69f-46ad-af03-dc309ff445cf tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:17.678249 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-84516a86-f69f-46ad-af03-dc309ff445cf tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:17.679059 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-84516a86-f69f-46ad-af03-dc309ff445cf tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:17.679518 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-84516a86-f69f-46ad-af03-dc309ff445cf tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:17.846242 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-84516a86-f69f-46ad-af03-dc309ff445cf tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a345b057104e559c3a3e8826cf10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2d1be987d44e91a0bfaaaf47b3235f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:32:17.858542 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-84516a86-f69f-46ad-af03-dc309ff445cf tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] 10.222.0.60 "GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c" status: 200 len: 1756 microversion: 2.1 time: 0.194417 Dec 15 16:32:17.859343 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 541/1070] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:32:17 2021] GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c => generated 1756 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:32:18.877786 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-a59e3d7e-af1f-4b23-b5e9-4df59b51e505 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:32:18.878429 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-a59e3d7e-af1f-4b23-b5e9-4df59b51e505 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] [instance: a11a4277-5614-4ba2-8452-4d7a8739292c] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:32:18.885312 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a59e3d7e-af1f-4b23-b5e9-4df59b51e505 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:18.885758 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a59e3d7e-af1f-4b23-b5e9-4df59b51e505 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:18.886532 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a59e3d7e-af1f-4b23-b5e9-4df59b51e505 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:18.886959 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-a59e3d7e-af1f-4b23-b5e9-4df59b51e505 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:19.042467 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-a59e3d7e-af1f-4b23-b5e9-4df59b51e505 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a345b057104e559c3a3e8826cf10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2d1be987d44e91a0bfaaaf47b3235f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:32:19.050839 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-a59e3d7e-af1f-4b23-b5e9-4df59b51e505 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] 10.222.0.60 "GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c" status: 200 len: 1756 microversion: 2.1 time: 0.176821 Dec 15 16:32:19.051438 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 530/1071] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:32:18 2021] GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:32:20.070891 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-7171e369-5679-41fa-af21-7cb3a44c5de1 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:32:20.071708 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-7171e369-5679-41fa-af21-7cb3a44c5de1 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] [instance: a11a4277-5614-4ba2-8452-4d7a8739292c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:32:20.078776 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7171e369-5679-41fa-af21-7cb3a44c5de1 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:20.079250 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7171e369-5679-41fa-af21-7cb3a44c5de1 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:20.080047 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7171e369-5679-41fa-af21-7cb3a44c5de1 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:20.080476 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-7171e369-5679-41fa-af21-7cb3a44c5de1 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:20.238260 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-7171e369-5679-41fa-af21-7cb3a44c5de1 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a345b057104e559c3a3e8826cf10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2d1be987d44e91a0bfaaaf47b3235f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:32:20.247656 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-7171e369-5679-41fa-af21-7cb3a44c5de1 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] 10.222.0.60 "GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c" status: 200 len: 1756 microversion: 2.1 time: 0.181767 Dec 15 16:32:20.248126 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 542/1072] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:32:20 2021] GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:32:21.269292 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-75ec841f-e126-45bb-b86a-9fb014f8dd93 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:32:21.269922 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-75ec841f-e126-45bb-b86a-9fb014f8dd93 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] [instance: a11a4277-5614-4ba2-8452-4d7a8739292c] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:32:21.279305 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-75ec841f-e126-45bb-b86a-9fb014f8dd93 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:21.279987 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-75ec841f-e126-45bb-b86a-9fb014f8dd93 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:21.281166 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-75ec841f-e126-45bb-b86a-9fb014f8dd93 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:21.281771 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-75ec841f-e126-45bb-b86a-9fb014f8dd93 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:21.436322 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-75ec841f-e126-45bb-b86a-9fb014f8dd93 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a345b057104e559c3a3e8826cf10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2d1be987d44e91a0bfaaaf47b3235f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:32:21.444510 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-75ec841f-e126-45bb-b86a-9fb014f8dd93 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] 10.222.0.60 "GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c" status: 200 len: 1756 microversion: 2.1 time: 0.181286 Dec 15 16:32:21.445109 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 531/1073] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:32:21 2021] GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:32:22.469004 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-1541f229-cc10-4757-b481-5a6f04aa4428 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:32:22.469830 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-1541f229-cc10-4757-b481-5a6f04aa4428 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] [instance: a11a4277-5614-4ba2-8452-4d7a8739292c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:32:22.480406 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1541f229-cc10-4757-b481-5a6f04aa4428 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:22.480865 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1541f229-cc10-4757-b481-5a6f04aa4428 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:22.482051 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1541f229-cc10-4757-b481-5a6f04aa4428 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:22.482773 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-1541f229-cc10-4757-b481-5a6f04aa4428 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:22.652278 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-1541f229-cc10-4757-b481-5a6f04aa4428 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a345b057104e559c3a3e8826cf10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2d1be987d44e91a0bfaaaf47b3235f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:32:22.660827 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-1541f229-cc10-4757-b481-5a6f04aa4428 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] 10.222.0.60 "GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c" status: 200 len: 1756 microversion: 2.1 time: 0.197957 Dec 15 16:32:22.661425 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 543/1074] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:32:22 2021] GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c => generated 1756 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:32:23.680361 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-0fb98824-ad16-476c-97fc-b72bc2bdabec tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:32:23.680920 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-0fb98824-ad16-476c-97fc-b72bc2bdabec tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] [instance: a11a4277-5614-4ba2-8452-4d7a8739292c] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:32:23.687854 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0fb98824-ad16-476c-97fc-b72bc2bdabec tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:23.688317 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0fb98824-ad16-476c-97fc-b72bc2bdabec tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:23.689154 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0fb98824-ad16-476c-97fc-b72bc2bdabec tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:23.689603 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0fb98824-ad16-476c-97fc-b72bc2bdabec tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:23.849158 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-0fb98824-ad16-476c-97fc-b72bc2bdabec tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a345b057104e559c3a3e8826cf10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2d1be987d44e91a0bfaaaf47b3235f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:32:23.858459 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-0fb98824-ad16-476c-97fc-b72bc2bdabec tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] 10.222.0.60 "GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c" status: 200 len: 1756 microversion: 2.1 time: 0.183284 Dec 15 16:32:23.859262 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 532/1075] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:32:23 2021] GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c => generated 1756 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:32:24.878296 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ebb33544-0a1e-4c98-8499-56b68566d8f3 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:32:24.878932 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ebb33544-0a1e-4c98-8499-56b68566d8f3 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] [instance: a11a4277-5614-4ba2-8452-4d7a8739292c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:32:24.886414 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ebb33544-0a1e-4c98-8499-56b68566d8f3 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:24.886868 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ebb33544-0a1e-4c98-8499-56b68566d8f3 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:24.887688 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ebb33544-0a1e-4c98-8499-56b68566d8f3 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:24.888120 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ebb33544-0a1e-4c98-8499-56b68566d8f3 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:25.045805 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-ebb33544-0a1e-4c98-8499-56b68566d8f3 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a345b057104e559c3a3e8826cf10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2d1be987d44e91a0bfaaaf47b3235f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:32:25.053905 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ebb33544-0a1e-4c98-8499-56b68566d8f3 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] 10.222.0.60 "GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c" status: 200 len: 1756 microversion: 2.1 time: 0.179442 Dec 15 16:32:25.054476 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 544/1076] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:32:24 2021] GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:32:26.072500 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-4c3f3ac8-dc6f-400e-b998-02b8a656058c tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:32:26.073147 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-4c3f3ac8-dc6f-400e-b998-02b8a656058c tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] [instance: a11a4277-5614-4ba2-8452-4d7a8739292c] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:32:26.080504 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4c3f3ac8-dc6f-400e-b998-02b8a656058c tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:26.080964 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4c3f3ac8-dc6f-400e-b998-02b8a656058c tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:26.081754 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4c3f3ac8-dc6f-400e-b998-02b8a656058c tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:26.082191 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4c3f3ac8-dc6f-400e-b998-02b8a656058c tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:26.239986 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-4c3f3ac8-dc6f-400e-b998-02b8a656058c tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a345b057104e559c3a3e8826cf10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2d1be987d44e91a0bfaaaf47b3235f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:32:26.249511 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-4c3f3ac8-dc6f-400e-b998-02b8a656058c tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] 10.222.0.60 "GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c" status: 200 len: 1759 microversion: 2.1 time: 0.181468 Dec 15 16:32:26.250053 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 533/1077] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:32:26 2021] GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c => generated 1759 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:32:55.775219 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:32:55.775991 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: Wed Dec 15 16:32:55 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:32:58.416273 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-8ac91335-ecaa-436d-a72d-ad6a2c121edf tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1763272433"}} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:32:58.416841 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-8ac91335-ecaa-436d-a72d-ad6a2c121edf tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] [instance: a11a4277-5614-4ba2-8452-4d7a8739292c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:32:58.423292 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8ac91335-ecaa-436d-a72d-ad6a2c121edf tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:58.423774 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8ac91335-ecaa-436d-a72d-ad6a2c121edf tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:58.424553 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8ac91335-ecaa-436d-a72d-ad6a2c121edf tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:58.424987 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-8ac91335-ecaa-436d-a72d-ad6a2c121edf tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:58.569215 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.network.security_group_api [None req-8ac91335-ecaa-436d-a72d-ad6a2c121edf tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Removing security group 53f853d4-c2ca-4af6-a5d5-9043fd6a5869 from port 69178240-43dc-4650-a6a4-f74c6c15626c Dec 15 16:32:58.936056 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-8ac91335-ecaa-436d-a72d-ad6a2c121edf tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] 10.222.0.60 "POST /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c/action" status: 202 len: 0 microversion: 2.1 time: 0.523656 Dec 15 16:32:58.936724 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 545/1078] 10.222.0.60 () {60 vars in 1277 bytes} [Wed Dec 15 16:32:58 2021] POST /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c/action => generated 0 bytes in 525 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:32:58.947813 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [req-8ea76de9-9de7-467b-a627-d6f654ca8da2 req-d379189c-926d-4f14-a44c-8d011ecf5eca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a11a4277-5614-4ba2-8452-4d7a8739292c", "tag": "69178240-43dc-4650-a6a4-f74c6c15626c"}]} {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:32:58.949397 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:32:58.949397 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: warnings.warn(msg) Dec 15 16:32:58.959932 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-8ea76de9-9de7-467b-a627-d6f654ca8da2 req-d379189c-926d-4f14-a44c-8d011ecf5eca service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:32:58.963095 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [req-8ea76de9-9de7-467b-a627-d6f654ca8da2 req-d379189c-926d-4f14-a44c-8d011ecf5eca service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:32:58.978701 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.compute.server_external_events [req-8ea76de9-9de7-467b-a627-d6f654ca8da2 req-d379189c-926d-4f14-a44c-8d011ecf5eca service nova] Creating event network-changed:69178240-43dc-4650-a6a4-f74c6c15626c for instance a11a4277-5614-4ba2-8452-4d7a8739292c on hv-cinder-81268 Dec 15 16:32:58.988232 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [req-8ea76de9-9de7-467b-a627-d6f654ca8da2 req-d379189c-926d-4f14-a44c-8d011ecf5eca service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044431 Dec 15 16:32:58.992201 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 534/1079] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:32:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:33:00.443605 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-be18fcd0-09df-4500-98f2-64f2bb7578fb tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:00.444135 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-be18fcd0-09df-4500-98f2-64f2bb7578fb tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] [instance: a11a4277-5614-4ba2-8452-4d7a8739292c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:00.450340 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-be18fcd0-09df-4500-98f2-64f2bb7578fb tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:00.450802 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-be18fcd0-09df-4500-98f2-64f2bb7578fb tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:00.451630 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-be18fcd0-09df-4500-98f2-64f2bb7578fb tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:00.452065 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-be18fcd0-09df-4500-98f2-64f2bb7578fb tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:00.533304 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.objects.instance [None req-be18fcd0-09df-4500-98f2-64f2bb7578fb tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lazy-loading 'services' on Instance uuid a11a4277-5614-4ba2-8452-4d7a8739292c {{(pid=116084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:33:00.610718 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-be18fcd0-09df-4500-98f2-64f2bb7578fb tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c/os-volume_attachments/cd9667c7-32fa-4446-9342-3a5ffb640994" status: 202 len: 0 microversion: 2.1 time: 0.171203 Dec 15 16:33:00.611389 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 546/1080] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Dec 15 16:33:00 2021] DELETE /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c/os-volume_attachments/cd9667c7-32fa-4446-9342-3a5ffb640994 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 15 16:33:00.621180 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-27b0e053-e964-4131-aa81-d7c2880c4100 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:00.622195 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-27b0e053-e964-4131-aa81-d7c2880c4100 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] [instance: a11a4277-5614-4ba2-8452-4d7a8739292c] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:00.629227 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-27b0e053-e964-4131-aa81-d7c2880c4100 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:00.629677 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-27b0e053-e964-4131-aa81-d7c2880c4100 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:00.630488 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-27b0e053-e964-4131-aa81-d7c2880c4100 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:00.631105 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-27b0e053-e964-4131-aa81-d7c2880c4100 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:00.663713 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-27b0e053-e964-4131-aa81-d7c2880c4100 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] 10.222.0.60 "GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047369 Dec 15 16:33:00.664253 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 535/1081] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Dec 15 16:33:00 2021] GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 15 16:33:01.006487 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-52d43ec2-b414-47b9-85f5-833cd1ba9874 req-da8b27bd-1fe5-45a9-aff7-058f5e2eb45f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a11a4277-5614-4ba2-8452-4d7a8739292c", "tag": "69178240-43dc-4650-a6a4-f74c6c15626c"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:33:01.009019 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:33:01.009019 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:33:01.016288 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-52d43ec2-b414-47b9-85f5-833cd1ba9874 req-da8b27bd-1fe5-45a9-aff7-058f5e2eb45f service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:01.016729 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-52d43ec2-b414-47b9-85f5-833cd1ba9874 req-da8b27bd-1fe5-45a9-aff7-058f5e2eb45f service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:01.028224 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-52d43ec2-b414-47b9-85f5-833cd1ba9874 req-da8b27bd-1fe5-45a9-aff7-058f5e2eb45f service nova] Creating event network-changed:69178240-43dc-4650-a6a4-f74c6c15626c for instance a11a4277-5614-4ba2-8452-4d7a8739292c on hv-cinder-81268 Dec 15 16:33:01.034138 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-52d43ec2-b414-47b9-85f5-833cd1ba9874 req-da8b27bd-1fe5-45a9-aff7-058f5e2eb45f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033838 Dec 15 16:33:01.035028 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 547/1082] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:33:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:33:01.675683 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-1d2a6f97-d3ee-4b7e-b13f-ce32d6b8aaa3 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:01.676655 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-1d2a6f97-d3ee-4b7e-b13f-ce32d6b8aaa3 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] [instance: a11a4277-5614-4ba2-8452-4d7a8739292c] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:01.683270 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1d2a6f97-d3ee-4b7e-b13f-ce32d6b8aaa3 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:01.683748 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1d2a6f97-d3ee-4b7e-b13f-ce32d6b8aaa3 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:01.684527 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1d2a6f97-d3ee-4b7e-b13f-ce32d6b8aaa3 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:01.684934 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1d2a6f97-d3ee-4b7e-b13f-ce32d6b8aaa3 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:01.714898 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-1d2a6f97-d3ee-4b7e-b13f-ce32d6b8aaa3 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] 10.222.0.60 "GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043145 Dec 15 16:33:01.715513 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 536/1083] 10.222.0.60 () {58 vars in 1301 bytes} [Wed Dec 15 16:33:01 2021] GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 15 16:33:01.725941 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-23d6db98-6485-4263-9a91-06ae4994c2f0 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:01.726561 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-23d6db98-6485-4263-9a91-06ae4994c2f0 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] [instance: a11a4277-5614-4ba2-8452-4d7a8739292c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:01.733919 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-23d6db98-6485-4263-9a91-06ae4994c2f0 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:01.734366 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-23d6db98-6485-4263-9a91-06ae4994c2f0 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:01.735112 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-23d6db98-6485-4263-9a91-06ae4994c2f0 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:01.735603 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-23d6db98-6485-4263-9a91-06ae4994c2f0 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:01.816317 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-23d6db98-6485-4263-9a91-06ae4994c2f0 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] HTTP exception thrown: Instance a11a4277-5614-4ba2-8452-4d7a8739292c is not attached to volume cd9667c7-32fa-4446-9342-3a5ffb640994 Dec 15 16:33:01.816922 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-23d6db98-6485-4263-9a91-06ae4994c2f0 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Returning 404 to user: Instance a11a4277-5614-4ba2-8452-4d7a8739292c is not attached to volume cd9667c7-32fa-4446-9342-3a5ffb640994 {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:33:01.817750 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-23d6db98-6485-4263-9a91-06ae4994c2f0 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c/os-volume_attachments/cd9667c7-32fa-4446-9342-3a5ffb640994" status: 404 len: 154 microversion: 2.1 time: 0.096109 Dec 15 16:33:01.818293 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 548/1084] 10.222.0.60 () {58 vars in 1415 bytes} [Wed Dec 15 16:33:01 2021] DELETE /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c/os-volume_attachments/cd9667c7-32fa-4446-9342-3a5ffb640994 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:33:02.956697 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-4d191c11-1e2e-4a5b-9b70-984f777f6549 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:02.957294 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-4d191c11-1e2e-4a5b-9b70-984f777f6549 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] [instance: a11a4277-5614-4ba2-8452-4d7a8739292c] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:02.964422 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4d191c11-1e2e-4a5b-9b70-984f777f6549 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:02.964871 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4d191c11-1e2e-4a5b-9b70-984f777f6549 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:02.965662 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4d191c11-1e2e-4a5b-9b70-984f777f6549 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:02.966091 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-4d191c11-1e2e-4a5b-9b70-984f777f6549 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:02.995953 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-4d191c11-1e2e-4a5b-9b70-984f777f6549 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] [instance: a11a4277-5614-4ba2-8452-4d7a8739292c] Going to try to terminate instance {{(pid=116085) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 15 16:33:03.081905 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-4d191c11-1e2e-4a5b-9b70-984f777f6549 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c" status: 204 len: 0 microversion: 2.1 time: 0.128696 Dec 15 16:33:03.082788 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 537/1085] 10.222.0.60 () {58 vars in 1238 bytes} [Wed Dec 15 16:33:02 2021] DELETE /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 15 16:33:03.090877 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-3e4d4166-b1d4-4a3f-9511-098ec08e2810 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:03.091599 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-3e4d4166-b1d4-4a3f-9511-098ec08e2810 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] [instance: a11a4277-5614-4ba2-8452-4d7a8739292c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:03.098114 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3e4d4166-b1d4-4a3f-9511-098ec08e2810 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:03.098555 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3e4d4166-b1d4-4a3f-9511-098ec08e2810 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:03.099357 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3e4d4166-b1d4-4a3f-9511-098ec08e2810 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:03.099993 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-3e4d4166-b1d4-4a3f-9511-098ec08e2810 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:03.244582 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.policy [None req-3e4d4166-b1d4-4a3f-9511-098ec08e2810 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a345b057104e559c3a3e8826cf10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2d1be987d44e91a0bfaaaf47b3235f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116084) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:33:03.256884 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-3e4d4166-b1d4-4a3f-9511-098ec08e2810 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] 10.222.0.60 "GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c" status: 200 len: 1553 microversion: 2.1 time: 0.169568 Dec 15 16:33:03.257787 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 549/1086] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:33:03 2021] GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c => generated 1553 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:33:04.276326 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-0fe07b85-f0c0-473b-9f0d-87db9ef83d3f tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:04.276955 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-0fe07b85-f0c0-473b-9f0d-87db9ef83d3f tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] [instance: a11a4277-5614-4ba2-8452-4d7a8739292c] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:04.284029 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0fe07b85-f0c0-473b-9f0d-87db9ef83d3f tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:04.284475 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0fe07b85-f0c0-473b-9f0d-87db9ef83d3f tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:04.285292 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0fe07b85-f0c0-473b-9f0d-87db9ef83d3f tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:04.285716 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-0fe07b85-f0c0-473b-9f0d-87db9ef83d3f tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:04.434303 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-0fe07b85-f0c0-473b-9f0d-87db9ef83d3f tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a345b057104e559c3a3e8826cf10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2d1be987d44e91a0bfaaaf47b3235f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:33:04.441905 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-0fe07b85-f0c0-473b-9f0d-87db9ef83d3f tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] 10.222.0.60 "GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c" status: 200 len: 1553 microversion: 2.1 time: 0.170077 Dec 15 16:33:04.442692 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 538/1087] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:33:04 2021] GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c => generated 1553 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:33:05.303594 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [req-778dfc8a-00a0-4d9d-9c8a-1ae91e6f32e3 req-b2564158-4b13-4591-8a47-b44153ec9450 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a11a4277-5614-4ba2-8452-4d7a8739292c", "name": "network-vif-deleted", "tag": "69178240-43dc-4650-a6a4-f74c6c15626c"}]} {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 15 16:33:05.305097 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 15 16:33:05.305097 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: warnings.warn(msg) Dec 15 16:33:05.312782 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-778dfc8a-00a0-4d9d-9c8a-1ae91e6f32e3 req-b2564158-4b13-4591-8a47-b44153ec9450 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:05.313271 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [req-778dfc8a-00a0-4d9d-9c8a-1ae91e6f32e3 req-b2564158-4b13-4591-8a47-b44153ec9450 service nova] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:05.326533 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.compute.server_external_events [req-778dfc8a-00a0-4d9d-9c8a-1ae91e6f32e3 req-b2564158-4b13-4591-8a47-b44153ec9450 service nova] Creating event network-vif-deleted:69178240-43dc-4650-a6a4-f74c6c15626c for instance a11a4277-5614-4ba2-8452-4d7a8739292c on hv-cinder-81268 Dec 15 16:33:05.331813 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [req-778dfc8a-00a0-4d9d-9c8a-1ae91e6f32e3 req-b2564158-4b13-4591-8a47-b44153ec9450 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031915 Dec 15 16:33:05.332390 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 550/1088] 10.222.0.60 () {64 vars in 1317 bytes} [Wed Dec 15 16:33:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 15 16:33:05.459381 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-1760879f-f6d0-40f0-b4fe-907943d31edc tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Calling method '>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:05.460002 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.compute.api [None req-1760879f-f6d0-40f0-b4fe-907943d31edc tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] [instance: a11a4277-5614-4ba2-8452-4d7a8739292c] Fetching instance by UUID {{(pid=116085) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:05.467395 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1760879f-f6d0-40f0-b4fe-907943d31edc tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:05.467669 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1760879f-f6d0-40f0-b4fe-907943d31edc tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:05.468467 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1760879f-f6d0-40f0-b4fe-907943d31edc tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:05.468934 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1760879f-f6d0-40f0-b4fe-907943d31edc tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:05.500407 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1760879f-f6d0-40f0-b4fe-907943d31edc tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:05.500860 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG oslo_concurrency.lockutils [None req-1760879f-f6d0-40f0-b4fe-907943d31edc tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:05.501311 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.objects.instance [None req-1760879f-f6d0-40f0-b4fe-907943d31edc tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lazy-loading 'fault' on Instance uuid a11a4277-5614-4ba2-8452-4d7a8739292c {{(pid=116085) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 15 16:33:05.553038 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.policy [None req-1760879f-f6d0-40f0-b4fe-907943d31edc tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88a345b057104e559c3a3e8826cf10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab2d1be987d44e91a0bfaaaf47b3235f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116085) authorize /opt/stack/nova/nova/policy.py:199}} Dec 15 16:33:05.560945 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-1760879f-f6d0-40f0-b4fe-907943d31edc tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] 10.222.0.60 "GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c" status: 200 len: 1348 microversion: 2.1 time: 0.105431 Dec 15 16:33:05.561642 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 539/1089] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:33:05 2021] GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c => generated 1348 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 15 16:33:06.581425 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ab511377-c56a-40cf-9f76-bfc6846a29d1 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Calling method '>' {{(pid=116084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:06.582024 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.compute.api [None req-ab511377-c56a-40cf-9f76-bfc6846a29d1 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] [instance: a11a4277-5614-4ba2-8452-4d7a8739292c] Fetching instance by UUID {{(pid=116084) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 15 16:33:06.588701 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ab511377-c56a-40cf-9f76-bfc6846a29d1 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:06.589195 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ab511377-c56a-40cf-9f76-bfc6846a29d1 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:06.589983 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ab511377-c56a-40cf-9f76-bfc6846a29d1 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 15 16:33:06.590419 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG oslo_concurrency.lockutils [None req-ab511377-c56a-40cf-9f76-bfc6846a29d1 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Lock "8cd537b1-8f24-4f5e-80d5-c8a6bb7b2b12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 15 16:33:06.604911 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.wsgi [None req-ab511377-c56a-40cf-9f76-bfc6846a29d1 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] HTTP exception thrown: Instance a11a4277-5614-4ba2-8452-4d7a8739292c could not be found. Dec 15 16:33:06.605551 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: DEBUG nova.api.openstack.wsgi [None req-ab511377-c56a-40cf-9f76-bfc6846a29d1 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Returning 404 to user: Instance a11a4277-5614-4ba2-8452-4d7a8739292c could not be found. {{(pid=116084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 15 16:33:06.606361 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO nova.api.openstack.requestlog [None req-ab511377-c56a-40cf-9f76-bfc6846a29d1 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] 10.222.0.60 "GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c" status: 404 len: 111 microversion: 2.1 time: 0.029689 Dec 15 16:33:06.606928 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: [pid: 116084|app: 0|req: 551/1090] 10.222.0.60 () {58 vars in 1235 bytes} [Wed Dec 15 16:33:06 2021] GET /compute/v2.1/servers/a11a4277-5614-4ba2-8452-4d7a8739292c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 15 16:33:06.615277 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: DEBUG nova.api.openstack.wsgi [None req-d8060980-f9a4-45f8-9155-c2d6800e4046 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] Calling method '.version_select at 0x7f0b268c80d0>' {{(pid=116085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 15 16:33:06.639812 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO nova.api.openstack.requestlog [None req-d8060980-f9a4-45f8-9155-c2d6800e4046 tempest-TestMinimumBasicScenario-813304446 tempest-TestMinimumBasicScenario-813304446-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2107665422" status: 202 len: 0 microversion: 2.1 time: 0.028241 Dec 15 16:33:06.640384 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: [pid: 116085|app: 0|req: 540/1091] 10.222.0.60 () {58 vars in 1271 bytes} [Wed Dec 15 16:33:06 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2107665422 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 15 16:33:13.903701 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:33:13.904256 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: Wed Dec 15 16:33:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:34:22.565384 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:34:22.566182 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: Wed Dec 15 16:34:22 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:34:22.590322 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:34:22.591168 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: Wed Dec 15 16:34:22 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:36:15.795826 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:36:15.796514 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: Wed Dec 15 16:36:15 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:36:33.923146 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:36:33.923866 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: Wed Dec 15 16:36:33 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:37:42.584399 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:37:42.584999 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: Wed Dec 15 16:37:42 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:37:42.612004 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:37:42.612501 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: Wed Dec 15 16:37:42 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:38:06.538441 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:38:06.539159 dv-cinder-812685-4-iscsi devstack@n-api.service[116084]: Wed Dec 15 16:38:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 15 16:38:10.046369 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 15 16:38:10.047008 dv-cinder-812685-4-iscsi devstack@n-api.service[116085]: Wed Dec 15 16:38:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!